Am I a dick for not switching days off with my female coworker?

It's your day off, so obviously you can do what you want with it. I'm assuming you didn't owe your coworker anything. She didn't offer you anything like covering your shift on a busy day or sucking your dick? If nothing, then don't feel bad.