It sounds like your tastes are similar to mine. What i read here is... You need a way to deal with the room note so you can explore tobaccos you would probably really enjoy.
I was also really concerned about smell, so What I have set up are 2 10inch fans that exhaust out a small window in a room that is 12 feet by 12 feet (whats that in metric, 3.5 meters). Honestly, you can't smell anything the next day. I also have a hepa filter, but i don't run it much.
I have a beard, too, and although my wife doesn't mind the smoke smell cigars and pipes, she hates the smell it leaves in my beard. I got some cheap beard oil off Amazon. It seems to do the trick.
I think you would be happier finding a way to deal with the smoke first, then smoking all kinds of blends.