You know, I had a long discussion with another poster here months ago, insisting that Maine was NOT built by slaves, thanks to slaves for its existence, etc. etc. And technically I was right, but further thought has made me realize that everyone in the country benefited from slave labor whether it was a slave state or not.
Every housewife who bought a cone of sugar. Every lumberjack who got a jug of rum. Every merchant who traded tobacco. A good portion of the construction force that built the WH was slave labor, even. It was so embedded and interwoven into our economic and production systems that no one could exist here without "benefiting" from it, even if they were actively smuggling slaves to northern states and Canada at the same time.
Not sure exactly how this tracks to the 100 years after the war, except blacks were still a dirt cheap labor force--but just about EVERYONE was in that boat during the awfullest of the Industrial age. Chinese, whites, immigrants from Europe--everyone suffered that.
I'm probably way off track. Just not sure where the OP wants to take this past the obvious fact that blacks did not have "equal" rights for the 100 years after the Civil War.