You don't understand. In the last 1 million years, 900,000 of those years had thousands of feet of ice covering all of Canada, NE US, Midwest US, northern Europe and northern Asia. Today that would displace at least 250 million people. Property losses would be in the thousands of trillions of dollars. Temperatures would be 12C colder than today. The ocean would suck up CO2 such that the planet would become dangerously close the the minimum threshold for plants to survive.
The planet's landmass (both polar regions thermally isolated from warm marine currents) is uniquely configured for frigid temperatures. That's why the planet cooled for millions of years with atmospheric CO2 of 600ppm to 1000 ppm.
The planet's climate is driven by how the ocean distributes heat around the planet. The landmass configuration and ocean currents are what control the climate of the planet; not the atmosphere. The vast majority of heat is stored in the oceans. The ocean contains 1000 times more heat than the atmosphere. The mass of the ocean is 300 times the mass of the atmosphere.
If you study the temperature record of the past 50 million years you cannot help but see that the planet has been cooling and that this cooling accelerated 3 to 5 million years ago such that our planet is now considered to be an icehouse planet.
I don't know how anyone can argue the risk of a warmer world is greater than the risk of a colder world. That applies to the likelihood of the event and the magnitude of the event.