Yes, I think you're right.
To be honest, when the person I was having this conversation with threw in, "hey, I'm a leftist and a Bernie Sanders fan," I bristled. It felt a bit like the old, "I'm can't be racist, I have a Black friend," argument. But I set that feeling aside and gave him the benefit of the doubt.
Some of the most racist people I've ever met have actually been upper middle class white women. As racist on the right, they just wrap it up in a prettier bow.