This is an honest answer….
To get a more “elegant” pipe smoking experience when in public…..
1. Dry the tobacco appropriately. Using pipe cleaners in public does not add to an “elegant” appearance.
2. Use common sense in terms of dress, mannerisms, having clean glasses (if wearing them), and be tidy.
3. Do not be “showy” but instead be gentle, calm, and subdued.
4. Have the experience where the pipe is NOT the “event” but is instead an aspect of what you are simply doing as part of another activity/event.
Basically, just simple, common-place thoughtfulness will make you appear “elegant” to others when smoking your pipe.
Now, that said…. there are times where you may not want or need “elegance” while smoking your pipe too. I have had many times of both across my many decades of pipe smoking. It is just basically working to “fit in” within the given situation.