I don't believe there were any 'illegals' during that time. Citizenship wasn't even defined until -- What? The 14th Amendment some 100 years later??
Back then, if you wanted to live here you could.
Voting was also much more restricted. You had to be a property owner or otherwise a Citizen In Good Standing to vote. And it was Men Only.
They way they looked at it back then, it wasn't so much that women were excluded from voting it was more like, One Household, One Vote, not One Man one vote. One Household. One vote.
They assumed that Husband and wife along with maybe Mother or Father in law as well as maybe -- Whatever, but they assumed there would be some back and forth and then the Head of The Household would cast his vote.
People forget, we are NOT a democracy. We never intended to be a democracy because -- They don't work.
We are a Republic. In fact, calling someone a 'democrat' back in the day would get you challenged to a duel. It was, and still is, a dirty word