Why is there the perception amongst the uninformed that men are just wearing gender-non-conforming clothes for their own sexual pleasure?

A few days ago, I came across a thread on one of the “men in skirts” forums I frequent that discussed whether it is illegal to wear skirts as a man in Italy. There were no solid conclusions which made me curious, so I did some research of my own and this is what I found.