The presence of heavy metals in municipal solid waste incineration (MSWI) fly ash is of environmental concern due to their leaching potential in landfill environments. Sequential chemical extraction was performed on fly ash samples from a large-scale municipal solid waste incineration plant in East China. The transformation of the mineralogical species of fly ash during the sequential extraction was studied using X-ray fluorescence (XRF) and X-ray powder diffraction (XRD). The leaching behavior of heavy metals such as zinc, lead, cadmium and copper in MSWI fly ash was considered to have a dependency relationship with the components of calcium, such as aphthitalite, calcite, anhydrite and calcium aluminate or calcium aluminosilicate.