I was never keen on Unity and similar frameworks. Maybe I just didn't get far enough into them to find out how to avert it, but it feels like they have their own idea of how everything should be structured and you have to work around that.
Much prefer something like MonoGame that just provides basic functionality to draw graphics and shit without having to mess with low level OpenGL functions and all that, while letting me structure my game however I want.