Ultimately, this is true. But you need to take the idea to its natural conclusion. ALL authority in our government comes from the "consent of the governed". That seems to be a quaint notion for Leftists. To them it means we'll obey what we want to, but YOU MUST obey without question.
Here's another Latin term you might ponder -
Civicus Bellum. Ultimately, this nation is built on compromise and a willingness to be held to account under law. Remove that court's ability to act as an unbiased arbiter of whether laws are Constitutional or not and it all collapses. The Trump impeachments are a perfect example. The Dems did everything in their power to push him from office, the Rs wouldn't vote to have it happen and a couple of issues went to the court for clarification. Take away the ability to have a "referee" and the fight spirals out of control.