We have developed a novel dual-window approach for spectroscopic optical coherence tomography (OCT) measurements and applied it to probe nuclear morphology in tissue samples drawn from the hamster cheek pouch carcinogenesis model. The dual-window approach enables high spectral and depth resolution simultaneously, allowing detection of spectral oscillations, which we isolate to determine the structure of cell nuclei in the basal layer of the epithelium. The measurements were executed with our parallel frequency domain OCT system, which uses light from a thermal source, providing high bandwidth and access to the visible portion of the spectrum. The structural measurements show a highly statistically significant difference between untreated (normal) and treated (hyperplastic/dysplastic) tissues, indicating the potential utility of this approach as a diagnostic method.