If there's one thing that absolutely drives me crazy, it's when conservative commentators start complaining that libertarians like me, and maybe you, are the real problem, because all we do is fight for drugs and gambling and pornography and prostitution, but we're unwilling to fight for liberty where it really counts, on the things that matter to conservatives.
I see various people on the right making this argument from time to time—it's a serious allegation, made by people who are either clueless about libertarians, or actively lying about us.