I think there is a tendency in people where they try to give their vices, obsessions, and other idiosyncrasies a veneer of potency and virtue, at least in their own minds. I've no real evidence to support my assumption save that of the anecdotal variety, but I think most people understand that we are defined, in part, but what we do; so, the temptation to view those things which we do often as being evidence of our good character is great.
This is not to say that pipe smoking is entirely devoid of anything that can promote virtue or happiness in the individual. But a pipe is only likely to encourage serenity and humane feeling for the individual that is both open to and readily seeking such things in the first place. A dickhead with a pipe in his mouth is still a dickhead.
As for those who denigrate those who smoke pipe? Well, for me, part of the fun of this hobby is that it is a vice, so I wouldn't mind someone being prickly about it. That being said, most people that confronted me about it were very polite and largely treated me as a quaint curiosity more than anything.