"Obviously the Constitution says that those powers belong with the Congress, but that's not much better than having the Fed do it. We need the market to be setting interest rates, not artificially manipulated. And calling for the market to set interest rates has nothing to do with us wanting free money, I'm not even sure how you come to that conclusion."
The difference is that Congress is elected by US (We the People) and answerable to US via elections, whereas the Fed Reserv is insulated and answerable only to its stockholders and has never even been audited. There's no such thing as a "free market" but only a market of 'interested parties,' and men do conspire, form trusts and cartels, hence the need for antitrust laws, etc. The real evil is when governments and industry collude to defraud the people of everything they own. So far our govt has just been bumbling stoopid, but injurious enough. The master-blaster team (bankers/govt) needs to be broken up.
Too many Americans (albeit a minority) see themselves as predators and are perfectly OK with that. They rail against social entitlements that cost a few billion to keep people alive while demanding trillions for themselves. They are called bankers. (I also have a beef with landlords, but without bankers to collude with, these parasites couldn't manage to force people from their homes and create a new subclass of disenfranchised renters.) Too many so called sophisticated investors are really just lazy bums looking for free money any way the "free market" allows, but unfortunately that includes coercion, exploitation and degrees of slavery, and no I'm not a communist; but do take note how many US captains of industry spouting libertine "freedom" quietly took their factories to where the slaves (fish-in-a-barrel) are-- communist Red China.
If government was the lender of record to everyone, then exploitation would end. It takes a new distribution system where bank owners are simply paid a distribution fee, no interest on loan amounts or percent of GNP. This idea was proposed over 100 years ago by Jeffrey Marks in his book: The Modern Idolatry
Gold and silver backing is history. Bankers were good at one thing, showing us that everything has a value and can serve as the basis for asset-based loans. The question is, how much of all you see, does the govt. own, vs you own. There are many other facets that need to be worked out to create a Just economy. Get to work.