My Nording cake, despite all that I do to stop them. As MSO, I too am in the cake fighter camp. I wipe mine out after each smoke also, reaming it with a paper towel. It could me what you are smoking. Virginias seem to make a hard compact cake. Burleys and latakia blends tend to make a fluffier softer cake, and aromatics... well... my aromatic pipes don't seem to have any cake. But, I tend to smoke the Virginia based aromatics, so I am not sure on that one.
I wouldn't worry about it though. Soon enough you'll be fighting back that chamber choking crappy cake mess. I know that some of the older smokers I knew growing up praised a good cake in their Grabows, but then usually just tossed the pipe when they couldn't even get a pencil down the center. Me? I just leave a thickness of a credit card worth of cake in mine. Ream back with a paper towel after each smoke, and yet still I have to shave it back occasionally with my pocket knife.
I don;t think it's all that important, myself, but if you're anxious, just wait...