I absolutely agree, though I do believe that, for felons, there should be a reapplication process for voting rights.
And I did say "voting rights." Voting is a right in America. But don't take my word for it:
The right of citizens of the United States to vote in any primary or other election for President or Vice President, for electors for President or Vice President, or for Senator or Representative in Congress, shall not be denied or abridged by the United States or any State by reason of failure to pay any poll tax or other tax.