Yeah, I think you pretty much have to let your tastes choose the direction, and more or less be in complete submission to them. Otherwise you may find yourself fighting a losing battle, trying to conform to some predetermined ideal. Not only is that a battle you aren't likely to win, but it will surely burn off (no pun intended) a lot of the enjoyment of the "new" feeling that first exists when you are in the early stages of pipe smoking.
When I first started, I emphatically disliked straight stems and any type of sandblast or rustication. I also only had an exclusive interest in billiards, and indiscriminately disliked all other shapes! Why? To this day, I have no idea. I tried, after the fact, to get into my headspace of four years ago when I was just starting out, but I cannot, for the life of me, ascertain a reason for any of these "preferences." Whatever the reasons might have been, my tastes in both pipes and tobacco have changed completely, although I still prefer bent stems to straight (as opposed to an outright aversion to the latter), and I still enjoy aromatics just as much, so long as they aren't a goopy romp in the PG.
Tastes can change with the direction of the wind. So I say just go with it. It's a journey!