Just face the fact that most conservatives would like to roll back anti-discrimination laws to the point where the whites-only diner could operate unfettered.
Based on my experience a few days ago involving two black females and their children they let run wild while people were trying to eat, I'm good with that.
I also believe that if a black owned restaurant wanted to do such a thing with whites, they should be able to do so. However, there's only so much money that can be made from serving fried chicken, watermelon, and collard greens.