Idk if you noticed this yet, but he seems to only get memories of the future in flashes.
Is that really how it happened? Would make sense given how frustratingly careless the hero was around the "King". I figured it was such a delicate situation that he needed proof before taking action and because I don't remember Time Blob mentioning anything about losing memories. Later on the hero is seen recognizing things without flashes but maybe they're implied?