I would figure that if the Hero would lose his memory then the guardian of the Tower would have explicitly warned about it. I just think the Hero either careful or dense.