Upon the recommendation of @chasingembers in a post awhile back, I dumped my ashes before relighting a pipe that had been sitting for a bit. This not only did the trick to get rid of bad tastes for pipes I had set down for a few hours, but also smokes that seem to start going acrid 3/4 of the way down. Just dump and your back in business.