Wanda totally realizes what she's doing, she's just convinced herself otherwise, at least early on before she admits it. I will say though that I don't think her initial creation of the hex was deliberate, that was an uncontrolled explosion of emotion and power, but she kept it going even when she realized what was going on.