Or do you just not "feel" like you're male or female?
I identify as gender neutral. Thats pretty much how I look at it.
I've got a male body, but i don't actually connect with men, hate being around most men, and kind of have slight dismorphia with my junk. On the other hand, most of my closest friends are all chicks, I prefer the company of women in general, and click with them better.
That said though, Im not transgender or anything because I don't feel like I'm a woman trapped in a man's body. I just feel like the Neutral Planet Guys from Futurama, inside a man's body lol.