Some do (prefers tall), some do (prefers short), some don’t care either way, which is the case for pretty much any trait. Even serial killers get fanmail from people who get horny from that kind of thing.

Though the distribution isn’t neutral (as in the average pop might prefer it one way over the other).