John Scalzi attempts to explain privilege using a video-game metaphor in "Straight White Male: The Lowest Difficulty Setting There Is." It's a good metaphor in that is illuminates more than it obscures (the litmus test for metaphors).
Okay: In the role playing game known as The Real World, "Straight White Male" is the lowest difficulty setting there is.
This means that the default behaviors for almost all the non-player characters in the game are easier on you than they would be otherwise. The default barriers for completions of quests are lower. Your leveling-up thresholds come more quickly. You automatically gain entry to some parts of the map that others have to work for. The game is easier to play, automatically, and when you need help, by default it's easier to get.
Now, once you've selected the "Straight White Male" difficulty setting, you still have to create a character, and how many points you get to start — and how they are apportioned — will make a difference. Initially the computer will tell you how many points you get and how they are divided up. If you start with 25 points, and your dump stat is wealth, well, then you may be kind of screwed. If you start with 250 points and your dump stat is charisma, well, then you're probably fine. Be aware the computer makes it difficult to start with more than 30 points; people on higher difficulty settings generally start with even fewer than that.
As the game progresses, your goal is to gain points, apportion them wisely, and level up. If you start with fewer points and fewer of them in critical stat categories, or choose poorly regarding the skills you decide to level up on, then the game will still be difficult for you. But because you're playing on the "Straight White Male" setting, gaining points and leveling up will still by default be easier, all other things being equal, than for another player using a higher difficulty setting.