Freedom, for it to function well, has to be controlled well.
It's like anarchy (from the opposite argument). You can't have anarchy that isn't controlled well, because it'll just end up with people taking control and stopping the anarchy. So the only good anarchy is controlled anarchy (which isn't anarchy).
And the same for freedom. 100% freedom is not going to be freedom, it's going to be anarchy, which can't work, because people will just take it over and turn it into something else.
So you have to decide how much freedom is still "freedom" and where the line goes when you lose that freedom.