That's not something really anyone but you can decide. It's not like stealing. We all know stealing is wrong and not personal opinion, but everything except certain facts are completely up to the smoker. The only sure fired right and wrong are that it's right to smoke pipe tobacco in a device meant for pipe tobacco, you must light it and set it on fire some how to smoke it, and then you must pull on the pipe tobacco smoking device to keep it going. That's about it for what's "right".
What you smoke it in, how you light it, what you light it with, what tobacco you choose, how much to dry it, how tightly or loosely to pack it, how much puffing you need to do, how long it smokes for, when and how hard to tamp it, whether or not to inhale are all choices left up to the individual.
Personally, it's wrong for me. I've inhaled it on accident a few times and it wasn't very pleasant. I mean, when you're smoking something strong like Black Frigate and the minute you breathe in after expelling a big puff of smoke, the wind blows it back in your face, it's a completely unexpected thing. Maybe because it was unexpected and not intentional, it was rougher, but I did not enjoy it. I want to enjoy my pipe smoking, not grimace at the very thought.