I love the cooler weather (we don't get past 30 degrees very often in the Pacific Northwest).
I can smoke in my shop, but if I'm there I'm usually too busy to smoke, so it's the house for me. My place on the couch is right where the window opens, so I crack it about an inch and settle in.
Even though my wife is an asthmatic, for some reason the smoke doesn't bother her (Winton I feel for you - a severe attack is terrifying) so I'm lucky. If the smoke smell gets a little thick, the windows opens wider, and the fireplace burns hotter.
I'm hoping that when I retire I can make it to the Seattle Pipe Club, but right now it just wouldn't work for me.