The problem isn't really the number of characters but the problems that generally tend to come with larger casts. The game could be harder to balance and although you have 50 characters, about 40 of them could end up just being garbage/fodder.
Also so many matchups you have to learn. =o