Up to this point, my habit has been to hold my pipe whenever I'm not actively drawing and only leave it in my mouth when I need two hands for a moment.
That's how I smoke my pipe most of the time. Been doing the same for many years. Only clench when posing for pictures.