Have you been to westeros.org? About half of the people there hate him! (Although the other half has good taste and recognize his gloriousness.) He's very underrated IMO.
I just can't wait until he arrives to Harrenhal in the series. I'm pretty sure they added additional scenes between Arya and Tywin, and since Maisie Williams and Charles Dance are both amazing actors, well... it'll be fun!
--
When you have nothing to say, quote yourself ~ Solfadore