Yes, you CAN smoke without the filter, but I wouldn't suggest it. Just like any other pipe with a filter system, you will learn to smoke it to get the best out of it. If you are cleaning your filters (or rotating them out for fresh and allowing the old to dry out), then you will find that the pipe just needs getting used to. I personally love the Brigham filters (it is the only filter that I actually WANT in my pipes), and I find that it sucks up a lot of moisture that you don't even realize accumulates. The Brighams are designed to smoke with the filter (and does not advertise that you should or should not smoke with/without it...unlike the Savinelli balsams which say you can smoke without if you wish). You'll quickly adapt to smoking with the Brighams. If you do a quick search on Brigham Filters in the forum search function, you'll find a lot of info on how to clean and maintain your filters.
Enjoy!
Shutterbug