I'm not American, I'm Canadian, but what you say is absolutely true. I'm biracial, but if you see my little pic, I look pretty damn white. Hell, I'm paler than most actual white people despite having a Black father. If I didn't tell people about my father, nobody would have any idea. That being said, it gives me a unique perspective that completely validates the existence of white privilege.
I have siblings, 2 full and several half, who all either are Black or look more Black than me and the difference in how we experience the world, or how the world experiences us is startling!
To illustrate with a simple example: One summer I spent a month with my half siblings and my biological father. There was a corner store nearby. When I went in alone, I was greeted warmly, given space to browse, etc. When I went in with my siblings, we were greeted with scorn and suspicion and told "buy and go." It's only one example, but the point is clear and, unrefutable.