"It was just a crazy thing to say. And Joe fought back, which was good, I guess," he said. "Once they find out you're rich... You're done 100% you're done." He added: "You have that people like you. That's not always, some people are just weird. They'll never like you".