The problem isn't playing as other people. The problem is "here's a unique gimmick you'll never use again that is just annoying".
Chapter 11 is the worst example though. Most dogshit section of any game that I'd rate 10/10.
https://i.gyazo.com/6fde58a9d13e1f9272a6d6eab35bcff7.png