I capitalize both (of course I'm mixed race) when I'm referring to people, but leave them lower case when describing the colours themselves or objects (black cat, white plate, etc.)

Funny, I'm not even sure when I started noticing or capitalizing when it came to describing race or people, but now you've clued me in. Thank you for that.