I live in Idaho..and sometimes..I'm one of those people...not with a permit..since we don't bother with such here--but certainly armed. Not that often..cause, well..why, right?
Not a great deal of street violence here. It is a point of pride for people to be versed in the handling of firearms...and any amateurish handling usually brings people out of the woodwork to correct the abuser.
Nope....not worried about those folks. They have no status in the community..their word is not accepted over yours just because they have a badge.