I'm getting the impression that those ladies don't want the men smoking in the tea parlor, but, then again, they are all smiling. Maybe it's a flirty encounter... Or maybe the women are smiling out of discomfort. I know I smile when I'm uncomfortable telling someone to do something just because it's my job. But, smoking would still be very acceptable at this time, even in a tea room, right? And why would all four ladies come over to harass the men?
Maybe it is flirty. Either way, the cross armed woman is getting a kick out of what the forefront, gesturing woman is saying.