Life is simply too short and unpredictable to not live exactly the way that you please. Steve Jobs said in a speech one time that he used to wake up every morning, look in the mirror and ask himself questions like this. So now the question becomes what is it that you truly have to lose? If you pursue your dreams and you fail, sure you might be more financially unstable. But either way, even if you fail, you will end up back to where you are now.