But there has to be consideration; it'd have to be more than the man not wanting the child while the woman does.
I don't see why. In our current situation, all that's required for an abortion is the woman not wanting the child. What the man wants is irrelevant in that case. It seems that if both people have an interest in the fate of the baby, they should both have the same rights regarding it. Either require both parents to sign off on the abortion or let the man opt out of all responsibility. I'd be fine with either.