I have get the occasional weird stare but I have never being on a situation where someone just be rude on their comments to me because I'm smoking a pipe...
Most of the people comments are about where I get my pipe, what kind of tobacco and how long will take to finish a full bowl, and once on a while a girl will say something like smoking a pipe bring memories of her grandfather to what I always answer that then she can sit on my lap and tell me more, hahaha!!