In the past tense I'd rather you didn't take it out on me. We don't say I'd ratherYouDon't, we're talking about the present. It's like a second conditional: "I'd rather you worked a bit harder in the restaurant" If you want to criticize someone and ask them to behave differently that would be different.