To date, there are very few clinical reports that have compared the effects of ezetimibe on lipid parameters between hypercholesterolemic patients with and without type 2 diabetes mellitus (T2DM). In this study, we recruited patients for hypercholesterolemic groups with T2DM (n = 42; men/women = 24/18; HbA1c = 6.7 ± 5.4%) and without T2DM (n = 21; men/women = 7/14; HbA1c = 5.3 ± 0.4%). Patients were prescribed ezetimibe at a dose of 10 mg/daily for the course of the 12-week study. At baseline and after 12 weeks of treatment, several lipid parameters, including serum low-density-lipoprotein cholesterol (LDL-C), non-high-density-lipoprotein cholesterol (non-HDL-C), high-sensitivity C-reactive protein (hs-CRP), and cholesterol synthesis/absorption-related markers, were measured. Compared with those at the baseline, the levels of LDL-C, non-HDL-C, campesterol, and sitosterol were significantly reduced after 12 weeks of ezetimibe treatment in both groups. After adjusting for confounding factors, such as age, gender, smoking, and BMI, the levels of LDL-C and non-HDL-C displayed significantly greater reductions in the patients with T2DM (-25.1 ± 13.6% in LDL-C, -20.5 ± 11.2% in non-HDL-C) than those without T2DM (-20.5 ± 7.8% in LDL-C, P < 0.05; -17.4 ± 7.6% in non-HDL-C, P < 0.05). The reduction of the level of cholestanol was significantly and positively correlated with those of LDL-C and non-HDL-C in the patients with T2DM. Taken together, these findings indicate that ezetimibe could reduce the levels of atherogenic lipoproteins to a greater extent in hypercholesterolemic patients with T2DM than in those without T2DM.