If you smoke inside the smoke permeates all the surfaces. No amount of ventilation will keep that from happening. It's in the paint, carpet, drapes and other fabrics. You just live with it. As the smoker you will not notice the change so no problem for you, until you want to sell the property. Visitors will notice the stench immediately. This can be a positive or a negative depending on you relationship with the visitors.
Much as perfume, BO, etc, the reeking aroma can be attractive or off putting.
Unless you wear a smoking jacket and cap, and have no facial hair you carry the stench where ever you go so you do not notice it. My big, ol' handlebar is naturally grey. A few hours after a shower it is somewhat yellow and I'm sure smells of what ever blends I've been smoking. It just comes with the territory like the tiny holes in your pants and shirt. It's just part and parcel of the "hobby" as some so gently refer to pipe smoking.