I too live in Canada, where it's technically illegal to smoke virtually anywhere in public.
One of my favorite things to do is sit on a bench in the park across the street from me on a summer evening and have a smoke, but I am relegated to the far corner of the park. On the few occasions where someone has walked by close enough to notice me, all I've ever gotten is a glance.
On the other hand, I sometimes sit on my balcony to enjoy a bowl and almost without fail, my next door neighbour comes out, pokes her head around the divider between balconies and says "Hey Joe, thanks for the wonderful scent. You always remind me of childhood days and my father with his pipe"