Except here it's worse because not only did it actually happen in the movie, but we know that peggy married another man and had a full life with him, so cap effectively erases that man.
It's a new timeline, so he didn't erase that man, that men just never got with Peggy.