From where, then, do my rights come from?
They're inherent. Rights cannot be given, taken, traded or passed on. They can, and are, restricted and ignored.
They are not tangible. You have the right to do, think and act as you please- IF you cause harm to another then you have violated their rights and will be punished accordingly IF virtuous men have anything to do with it.
Grants and privileges are tangible and can be given, taken and rescinded. Those, in this case, are called inalienable rights (per the legal argument of the 14th amendment which Porter Rockwell has posted numerous times).
UNalienable rights are Endowed, by your Creator- that means "inherent". They are yours or mine or whomever's by being born.
Look closely at these words.
We hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness.--That to secure these rights, Governments are instituted among Men, deriving their just powers from the consent of the governed,
Men, grant authority to other men to govern, and, to "secure these rights" by governance. It is a privilege. It can be taken and/or rescinded by men and, according to the Declaration of Independence
That whenever any Form of Government becomes destructive of these ends, it is the Right of the People to alter or to abolish it, and to institute new Government, laying its foundation on such principles and organizing its powers in such form, as to them shall seem most likely to effect their Safety and Happiness. Prudence, indeed, will dictate that Governments long established should not be changed for light and transient causes; and accordingly all experience hath shewn, that mankind are more disposed to suffer, while evils are sufferable, than to right themselves by abolishing the forms to which they are accustomed.
If "Life" is taken (in any manner other than accident or self defense an immoral act has occurred).
If one has the "Right to Life", then one has the Right to Liberty (exercising wants wishes and desires of the exerciser at his discretion) - otherwise what is his point in living? To "pursue" Happiness is in order with the two previous which were said to be "among these are".
The exerciser makes the determination of "these" as he sees fit in his "pursuit" of his Happiness.