How do I turn down a job I already expected?

This does not sound stupid at all, probably exactly what I would do in this situation. Just be sure to leave the message AND call to talk to her, maybe she can pull some strings to offer you more money. Don't feel stupid. You are human and you have the right to change your mind. You also have the right to choose what's best for you and seems like you've done that. Good luck.