Is It Sinful for Men to Wear the Clothing of Women?

Is it sinful for men to wear the clothing of women? My sister says that it is not wrong, since clothes do not have gender. I think there has to be a kind of correspondence between interior and exterior. In religious life, there's hi tradition whereby you would avoid so called singularity because singularity gives rise to admiration or bewilderment. It's considered virtuous to just kind of blend in.