In a civilized society each person can not be free to do as they please ignoring what is best for society.
There was a time in America when 80% of the people and 90% of the workforce lived on farms. Most were self sufficient with very little dependence on others. It was within that environment the nation was created. What happened on the other side of the hill, in neighboring towns, or across the country had little on impact on our daily lives. Today, that is certainly not the case. We depend on our employers for jobs, government for protection, doctors and hospitals to maintain our health and often our very life. Most of our jobs depend on goods, service, and raw material produce around the country and around the world. Poverty and crime in ghettos overflows to the city and suburbs so when we ignore the plight of poor, we pay for it in higher rates of crime and other social problems. One crazed gunman in your kids school can destroy your family. Wars, natural disasters, and polices of other nations effects our daily lives.
In a world and a nation with so many interdependence, individual freedoms will suffer or the result will be chaos and the destruction of civilized society.