White privilege does not apply to all whites and if you don't know that then you have never been poor and had whites consider you to be no better than blacks or mexicans. They like to call us poor white trash, basically we are white blacks.
This is the mistake a lot of people make; basically, "my life wasn't easy, so how can you say I was advantaged." It's not that any white person will have more advantages than any person of color by a default, it's that being a combination of a straight, white, Christian, tall, male (among other things) will give certain advantages just by the nature of being that particular thing, that other people do not have.
Let's use one of my examples as a case study:
A white guy goes on match.com to try to find a date in his area. He's short, makes under 40,000 income, and overweight (three other things that women also avoid in percentages). He hears about white people having an advantage on dating sites and reacts angrily, saying "it's near impossible for me to get a date on their as well and plenty of black people can get dates, how do I have an advantage?!"
The flaw in their reasoning is that they're conflating large percentages with their personal experience, and then not making the experience relative to their own. Yes, a tall, rich black man would probably be more successful than him on there, even with 80% of women rejecting him even before they look at a picture of him. However, a short, poor, overweight black man will most likely do worse than him because 85% of the women that would still consider him, even with those disadvantages, would still not search/allow him because he's black. It's just one more thing to add to the checklist, that -can- actually be fixed on a societal level, with time.