I'm not racist, I'm just ignorant about race.

Julian Sanchez (via Andrew Sullivan)

Yet that's precisely why Paul's 1.0 argument breaks down on its own terms: at the scene of a four-century crime against humanity—the kidnap, torture, enslavement, and legal oppression of African-Americans—ideal theory fails. We libertarians, never burdened with an excess of governing power, have always had a utopian streak, a penchant for imagining what rich organic order would bubble up from the choices of free and equal citizens governed by a lean state enforcing a few simple rules. We tend to envision societies that, if not perfect, are at least consistently libertarian.

The caveat that Dr. Paul found necessary before making his libertarian argument against a portion of the civil rights act was "I'm not racist".  My feeling is that invariably, when someone has to say they're not racist they are usually saying something ignorant.  "I'm not racist, I'm just ignorant about race."