I started in college myself, and my first time out in public with one, was met with derision and comments of being too odd, so I kept it to myself for quite a while. Eventually, I was able to develop a "f*ck you" attitude about and with that confidence the derision stopped, as well as the compliments started to come. "Oh that smells nice" "My Dad (or Grandpa) smoked.
I will say that one of the smoke shop's in Boston is not to friendly to the younger generation (even to me now). The attitude towards the younger generation and pipe smoking in this shop is one of "why are you bothering". So there is a stigma out there to a certain extent.