There's nothing wrong with sounding a bit French, but it's very hard to convince French people of this. I don't think French people need to beat themselves up about English. Mixed accents are the norm everywhere. The more different types of English you listen to, the stronger your core understanding will be.