The stem has never bothered me, mainly because I don't know anything else...
The tobacco makes all the difference to me. I know pipe selection has a major influence over your smoking experience, but I'll be content enough with my stable of Country Gentlemen to live happily without briars.
Now in the unlikely circumstance that I come into a few dollars, I will revisit that claim and probably make pipe collecting an interest of mine...
(I've also never found the initial "corny" taste of cobs very noticeable, and certainly not unpleasant - doesn't take long to burn off, regardless)