Fortunately for the Europeans there were no immigration laws in America when they came over. So the xenophobes and racists who hated the Germans, Irish, Italians, Catholics, etc. couldn't stop them.
Dr Williams is confused and obviously lacked legal advice before granting said pardon. If he wants to renounce his claim for reparations this needs to be directed at the US government and not white people who never owned a slave.