Nope, there's really nothing more to it, at least not enough to vote for a Libertarian coatrack like Oliver.
The fact is, America is a racist nation and always has been. Obama winning in 2008 was a fluke in that Republicans had just screwed up so badly.
The reality is no one making less than 50K a year should be voting Republican, but about half of them do. And every time they get into power, Republicans give tax cuts to the rich and find new ways to screw dumb working people who keep voting Republican.