Sure, and it's fine when a meme flops. But this person was apparently being an asshole about the entire concept of memes.
My wife is into things I'm not into. Sometimes she even drops references to those things into conversations that I don't get. You know what I don't do? I don't say, "So, I'm supposed to memorize all these TV shows in order to have a conversation with you?" That's being a jerk, and completely unnecessary. I just kinda politely smile and nod, and move on.