I totally get what you're saying. I'm mixed race, Black father, white mother, but I look pretty white and am afforded the privilege associated with that, until my true ethnicity is made known. You're basically as white as people think you are and the privilege can be granted and rescinded accordingly.