Hardcore games existed before casuals entered the market. Hardcore games WERE the market, originally.The hardcore gamer market would have remained too small to sustain today's development costs.
I'm pretty sure the main complaint is historically hardcore series getting fundamental changes to appeal to a wider audience, one that seems to either complain anyway or not buy the game regardless.