Honestly to me it's just another genre that ranges from utter tripe to genuine masterpieces.
This is how I feel about it too.
Usually when people ask, I just don't say anything. It's like "Doctor Who"... I liked the show, but it wasn't my whole personality and the worst is someone asking then wanting to talk about what is or is not cannon, theories, etc. It's like "woah, chill, I just found the show entertaining, it isn't that serious". You just never know when someone does ask, which type of person/fan they are.
Same happens with anything really. But with anime, I don't know how to get across to
fanboys that I like some because it's good, not because it's specifically anime. Granted, I don't look at it with the same lense as I would a live-action TV show, but I don't look at TV-shows with the same lense as feature-length motion pictures, and none with the same lense as books. And there are a lot of anime that would only work in that medium and wouldn't translate to live-action or even just American-style animation.