I dont agree with punching people for words and symbols.
However, I wonder how different this conversation would be if he was a brown man wearing ISIS symbols instead of Nazi.
The examples aren't exactly equivocal because ISIS is an active terror threat whereas Nazism is (currently) an ideological threat. You wear a Nazi symbol and you're saying you have fucked up ideals. You wear an ISIS flag and you're saying you're on the side that's in an active state of military conflict with the United States.
Wearing the ISIS flag doesnt mean you are actually in ISIS though. Both ideologies support genocide and US has gone to war with both. Its the same to me.
US is actively engaged in a war with one and not the other though, that's the main difference. ---
