I personally believe it looks bad that you would quit as a manager. That's what entry level workers do...or at least more often than a manager.
Your next employer might be hesitant to hire a person who clearly cannot handle the stressors of management.
It would look clean and professional of you to at least give a 2 week notice and then bounce. This should provide you a much better shot at management positions elsewhere.