You don't seem to understand the basics, you're pulling your firearm out because you're facing imminent threat of death or great bodily harm, if that's not the case then you shouldn't drawing (or carrying around) your firearm. Learn how to avoid situations that lead to confrontations, get some quality self-defense training and carry a non-lethal, and you won't have to draw your firearm so damn often. Heaven forbid your luck runs out and you end up in jail behind an aggravated assault charge or worse IN THE MORGUE.
No, it's ok for you to pull your gun and not shoot, until it's not. I'll continue with my strategy of using my skillset to avoid having to draw my firearm unless it's to stop an imminent threat of death or great bodily harm, in which case I'll actually use it for what it's intended for.