Control of double ionization of He by means of the polarization and carrier-envelope phase (CEP) of an intense, few-cycle extreme ultraviolet (XUV) pulse is demonstrated numerically by solving the six-dimensional two-electron, time-dependent Schrödinger equation for He interacting with an elliptically polarized XUV pulse. Guided by perturbation theory (PT), we predict the existence of a nonlinear dichroic effect (∝I^{3/2}) that is sensitive to the CEP, ellipticity, peak intensity I, and temporal duration of the pulse. This dichroic effect (i.e., the difference of the two-electron angular distributions for opposite helicities of the ionizing XUV pulse) originates from interference of first- and second-order PT amplitudes, allowing one to probe and control S- and D-wave channels of the two-electron continuum. We show that the back-to-back in-plane geometry with unequal energy sharing is an ideal one for observing this dichroic effect that occurs only for an elliptically polarized, few-cycle attosecond pulse.