How to Defend Entrepreneurship in a Relationship

I had to defend my entrepreneurial aspirations to my peers at the last job that I was working in. When I when I was building feedback Panda, I kind of did it on the side while I was having a full salary 40 hour a week software engineering position in Hamburg. All this commute back and forth gave me so much time. They were like, why are you doing this? You already have a job. And the hardest part about all this was when I then quit because our business already went somewhere and I wanted to focus on something else; they felt almost betrayed. It's not your fault necessarily as an employee that this is the reality in which we live in but it's probably a misconception