High-finesse optical cavities have a wide range of applications, some of which are bichromatic. The successful operation of high-finesse bichromatic cavities can demand careful control on the temperature dependence of the wavelength-dependent reflection phase from the dielectric mirror coatings that constitute the optical cavity. We present dielectric coating designs that are optimized for minimal differential change in the reflection phase between a quasi-second-harmonic field and its fundamental field under temperature changes. These designs guarantee cavity resonance at a wavelength of interest via the control of its quasi-harmonic field. The proposed coating designs are additionally examined for their sensitivity to manufacturing errors in the coating layer thickness with promising results.