Then a simple enough solution. Let's get rid of legacies. That just means the rich white person who got in on a legacy will be replaced by an Asian kid who got in on test scores and GPA. Really won't do that much to help blacks.
Conversely, who is benefiting from AA now? Is it the black kid from the ghetto? Nope, it's usually the middle class or affluent black kid who comes from good circumstances because his parents did the hard work, but didn't get as good of grades and test scores as the Asian Kid who worked hard. Meanwhile, a lot of black kids are going to get free rides to college on Athletic Scholarships, even though if you watch some athletes on TV when they are being interviewed, they can't put together a coherent sentence in the King's English.
Final point. The ONLY reason why any cares about Harvard is that it and other Ivy League Schools are given an outsized role in business and politics. You have a Harvard Degree, that's a golden ticket for life, while the kid who did something like joined the military to pay for college and worked two minimum wage jobs while in attending classes will be happy to just get a state college degree.
So a simple enough solution-
Get rid of Legacies.
Ger rid of Athletic Scholarships
Get rid of Affirmative Action
Stop giving preferential hiring treatment to Ivy League schools.