Your stance isn't that bad. You'll probably be happier than someone up to their eyeballs in debt even if it isn't optimal. If you keep up with the investing you'll be setting yourself up for a good retirement. You still have a lot of time left to grow your money.
Many Bothans died to bring you this post.