Yeah maybe. For me it's always like having to think which is which.
I learned German, so capital letters for nouns isn't such a weird thing, but it massively messes with me when writing English (when I speak, the capital letters just flow naturally). The worst one is "century", I'm always writing "20th Century" and I have no idea why.
Perhaps for people "white" covers a lot of people, Irish, Italian, German, English, Eastern European, all have their capital letters, whereas "Black" is considered one.
Which would change how "racist" it looks.
If white covers many, then call them Europeans. If black is consider as one, then we may as well capitalize yellow because Asians are yellow skin.
The only reason I believe the media capitalize black is because majority of blacks don't know their roots unlike whites and Asians. White people can tell you their ancestry history as with Asians. Most blacks that were brought here as slaves probably have no idea where they came from or the name of the country they were living in prior to being sold because there was no written language and no map.