We have developed an interferometric implementation of coherent anti-Stokes Raman scattering which enables broadband coherent Raman spectroscopy free from the nonresonant background, with a signal strength proportional to concentration. Spectra encode mode symmetry information into the amplitude response, which can be directly compared to polarized spontaneous Raman spectra. The method requires only passive polarization optics and is suitable for a wide range of laser linewidths and pulse durations. The method's application to Raman spectral imaging is demonstrated.