I think in places that get a ton of "shine" like desert or plains areas the up front cost is made up by the "up time". Couple it with a decent battery farm and in some places you could probably go off grid most of the time.
The biggest concern is that ironically the best places for shine time also have PV cells worst enemy; sand.
Most people don't have the money to put up is the bottom line. If they did, it would be taking off. It is not, and it is pretty simple to conclude that most people just find this unaffordable. There is also maintenance to think of. I don't know what that consists of.
The type of person that can afford a nice spread of property and a ranch house somewhere in the desert can probably afford the cost of the panels.
The issue is always when activists propose a one size fits all solution to a problem.
And also in those areas the biggest power provider is a combo of hydro and nuclear, so they aren't even competing against coal and oil.