“Like a girl” is interesting, subject to interpretation. So not necessarily pejorative. (I do think we need a nanosecond, at least, to run the sniff test.)
Other sorts of cracks bother me more. Especially when they’re revealing subconscious attitudes…and so easily subconsciously accepted by the hearer. In many cases, could be a loaded message.
We often don’t even notice, and that’s the danger.