Elite in this case refers to the ability to exert power and privledge. Everyone who is in a society does so to some level. (Obviously much less)

It is not a term of adoration.