Seriously, because first hand smoke is a killer, and nobody disagrees. Even the tobacco companies. The evidence is there, it's unambiguous and it's beyond doubt.
Ever hear the claim "smoking pot aids terrorism?" When facts are blown out of proportion it's easy for many to just go along with it if they just simply don't like it. Fine, if you don't like it don't do it, but don't expect anyone to believe those claims. There is no hard evidence to support hysteria, none, all things we do have health risks, and serious ones at that. Coffee, alcohol, automobiles, most of our food, walking, hiking, skiing, etc.. We do these things knowing the risks, and no risk is greater than the other, living kills, it's a fact. But what people have done is instead of making living worth while, or at least worth it, they want to live forever, or force the rest of us to live longer than we are meant to or even want to. If I have to live without all my pleasures (I have so very few and smoking is one) then I see no point in living at all, which is a true health risk that has no cure.
I don't think people ae as much concerned with limiting your pleasures for your sake. At this point anyone who smokes is well aware of the dangers a smoker does to themself. The point of contention is imposing your smoking on others. None of the things you mention above, coffee, alcohol, etc are things that are transmitted from the the consumer into the body of another.
Pot smoke and excessive perfume are things which are very similar to cigarette smoke in that they affect the health and well being of the people nearby and they are also things which do not provide anything deemed a necessary evil such as tthe car exhaust from amulances trans porting smoker's to emergemcy rooms.

.
Like nicotine, pot can be comsumed in other ways besides smoking it, so limiting it's use doesn't deny users access to it. Perfume is different as it is intended to affect others and it ussually does not affect others in a way they appreciate. Particularly when it is used as a way to announce one's presence much in the same way shouting and other attention seeking behavior does. Maybe perfumed people enjoy the smell they project but since perfume does not provide one of those necessary evils - unless, I guess it is used to mask a biological smell the person can't control - I agree with regulations on the model of public nuisance and health concerns for use of perfume in public areas.
It sounds like you are saying that you'd rather not live if you can't smoke. I don't know if you intended it that way but it sounds like it could be a sort of threat of suicide if you can't smoke where you want. I'm truely sorry to hear that but I certainly would not consider that sort of emotional blackmail something to cater to.