Anybody who has grown up in the type of place you describe knows it takes more than how you "carry" yourself to survive and to be respected. There is a measure of street smarts and reading people. Always a having a means of escape and a silver tongue. Knowing the right people and discerning who is a paper asshole, half a wiseguy and the real thing. The list goes on...
that's only partly true....no one ever bothered me...a few assholes have tried to sandbag me...but..
It is not a question of being bothered, it is more a tool in reading situations and navigating those situations toward a positive end. For example, one night after I pulled duty I was in a neighborhood bar talking football, I disagreed with someone he pulled a gun out on me. That is not being bothered, that is living in a place where live is unpredictable and rules area applied as necessary.
The lesson I learned from the street is there is always someone who is bigger, faster and more sociopathic than I so be prepared. This small lesson has been a life saver not only on the streets, but, in professional life.