A while back I was reading a forum on a peripheral subject, and the term came up.
Commenter David captured and relayed more succinctly than I thoughts on the term, and it parallels my own some:
"If you are old enough to remember, think back to an episode of "All In The Family". Lionel (the son of the George and Weezy Jefferson), while talking to Archie Bunker, said something to the effect of
"You people....". Archie stopped him in mid-sentence and said,
"Who are you calling "you people"?
Youze people are "you people"!".
Of course part of the moral of the show's exchange was that neither side should lump all those unlike themselves into the single group of "you people", depriving the others of their individuality and pigeonholing them as all being alike (with the added implication that "you people" are somehow lesser than "we people").
You see, by one of "those people" turning the use of "you people" back on the people that call the others "you people",
Lionel exposed the problem with the common usage of the incorrect term by Archie - up until that point, Archie probably said it a dozen times and no one paid much attention!"
I remember those episodes, and I do think yes, a sitcom like Archie Bunker had a small but powerful effect on some of our daily discourse.
I will add, personally, I was never quite fully aware of the implications of the phrase till it was highlighted by that show.
Course that was some 35 years ago, and I was much younger then. *sigh*

Archie did bring the racial undertones, they still linger. It shouldn't.
What it highlights more, is, as manu said, there is no consensus usually and "every person sees their position as unique...."
I think most people use it much more benignly than not, and the hackles raised are more by people likely to be offended anyway - but it does remind us that many have an
us vs them mentality, and if you don't believe as I do, then you are one of "
youze people."