Honestly, I blame the history of the word and its relation to slurs for trans women. Femboy, trap, and multiple others started as words to describe trans women as actually just being a gay man trying to trick straight men into having sex with them by pretending to be a woman.

I’m glad to see that they’ve evolved beyond that into a very fun way for men to play and express themselves outside of the arbitrary gender binary, but I totally understand the gut reaction of basically “femboy = twink with extra steps.”