Before we moved into our current house a couple of years ago, we did some extensive renovations. I work from home, so the smallest bedroom became my office. I knew I also wanted a whole house fan for the warm but not hit months, so instead of putting it in the obvious spot in the ceiling of the second floor hallway, I put it in the office ceiling. When I smoke, I close the door and HVAC vent, crack the window several inches and turn the house fan on. The room gets a bit cold or hot, depending on the season, but moderated by the house air being pulled under the door. If I put a sweatshirt on, I can do this very comfortably even if the outdoor temp is 25 degrees. Given that the air being blown into the attic is primarily outside air and it’s more than adequately ventilated anyway, I doubt there’s any measurable cooling/heating of the attic.
And no, I don’t do this to placate my wife; I just don’t want a smoky house. If I leave the fan on for a few minutes after I’m done, there’s no lingering smell. The room is very small, so it heats up/cools down quickly when I open the door and HVAC vent.