We present a robust and straightforward approach for fabricating a novel colloidosome system where colloidal particles are assembled to form colloidal shells on the surface of stimuli-responsive microgel scaffolds. We demonstrate that the structural properties of the colloidal shells can be controlled through the colloidal particle size and modulus, and the state of supporting microgel particles. This technique offers a new way to engineer colloidosomes, enabling fine control over their permeability over a wide range of length scales.