I wouldn't worry too much. Maybe the mortise needs to dry a bit. Some pipes will get tight enough the stem won't fit back into mortise after a smoke, that is if you take the pipe apart during smoke like I do.
