You can only fight him at mid-dungeon stores, not the stores right before the boss battle.So it's a good idea to fight him later in Elysium when you're more well-equipped. I'd say he's not that rare to find, about 30%?
---
Into the woods, but mind the past... Into the woods, but mind the future!