It might be the fact that you are holding it by the stem instead of the bowl. The shank can handle the weight of the stem better than the stem can handle the weight of the bowl and shank. Even smoking it cool is likely to soften the insert enough that holding by the stem might be enough to cause it to crack.