The coupling of spin and valley physics is nowadays regarded as a promising route toward next-generation spintronic and valleytronic devices. In the aim of engineering functional properties for valleytronic applications, we focus on the ferroelectric heterostructure BiAlO3/BiIrO3, where the complex interplay among a trigonal crystal field, layer degrees of freedom, and spin-orbit coupling mediates a strong spin-valley coupling. Furthermore, we show that ferroelectricity provides a nonvolatile handle to manipulate and switch the emerging valley-contrasting spin polarization.