On what grounds is it unconstitutional?
The equal protection clause of the 14th Amendment. It's illegal for the government to discriminate on the basis of race.
How about an analogy?
Let say 7 people were riding together in a vehicle and got hit by a impaired driver. Two of the plaintiffs (husband and wife) file a lawsuit and receive damages for the harm caused by the damage done to their lives, while the other people who were in the vehicle didn't receive damages because they either 1) didn't file their own lawsuit or didn't join in as additional plaintiff's in the lawsuit filed by the husband and wife. There were nonetheless entitled to pursue a claim if they were injured and to have the person responsible pay damages to "make them whole again".
The argument you're making regarding the 14th amendment is comparable to you wanting to receive payment for a car accident when you weren't in the vehicle and even further you don't think anyone should because it wouldn't be fair to you, someone whose life was not impacted by the accident.