This is why I have a problem when people tell me I’m “privileged” just by virtue of my being a male.
As I wrote before, there are clueless social justice warriors who misuse the legitimate concept of privilege and treat it as dumb "I win" button in discussions. Those people act as if accidents of birth dismiss the validity of someone's arguments, and only personal experience can be used to find truth in the world. Those people are wrong and should not be taken seriously.
But the actual privilege arguments are much more modest and reasonable. They do not say that men or whites have every advantage in society, but say that there are certain scenarios where some people do not have to worry about certain things. Tim Wise used the example of a cop helping jimmy open the lock on his car without checking to make sure it was actually his. If Tim has been black, the cop probably would have at least asked.
But what Tim Wise and the other social justice warriors don't include in their message is that all groups have privilege, including women. Female privilege, for example, includes not worrying about being accused of pedophilia while interacting with kids, sitting next to them on a plane or when using a public skating rink bathroom.
As Warren Farrell said, our society is sexist against men and women at the same time in different ways. That is not to say that they automatically break even, but that the two are not mutually exclusive.
Many, many times I see someone going up against an activist by pointing out some injustice men face and asking how they could possibly be "privileged." When they say that, I know they don't really understand the concept, and they are guilty of making the same simplistic assumption the social justice warriors make by assuming only one group can experience harm at a time.