I think watching Captain America first has the most impact on avengers. There is a very short flashback in the movie to a part from CA for example.
The movie explains everything well enough that you could go into it completely blind and love it though. Going into it informed just enhances the movie.
--
~Ç~ http://img.imgcake.com/AlecTrevylan006/fdshieldpngyn.png Eff_Dee
http://img.imgcake.com/nio/9fdpngys.png