Development of the heart requires recruitment of cardiovascular progenitor cells (CPCs) to the future heart-forming region. CPCs are the building blocks of the heart, and have the potential to form all the major cardiac lineages. However, little is known regarding what regulates CPC fate and behavior. Activity of GATA4, SMARCD3 and TBX5 - the `cardiac BAF' (cBAF) complex, can promote myocardial differentiation in embryonic mouse mesoderm. Here, we exploit the advantages of the zebrafish embryo to gain mechanistic understanding of cBAF activity. Overexpression of smarcd3b and gata5 in zebrafish results in an enlarged heart, whereas combinatorial loss of cBAF components inhibits cardiac differentiation. In transplantation experiments, cBAF acts cell autonomously to promote cardiac fate. Remarkably, cells overexpressing cBAF migrate to the developing heart and differentiate as cardiomyocytes, endocardium and smooth muscle. This is observed even in host embryos that lack endoderm or cardiac mesoderm. Our results reveal an evolutionarily conserved role for cBAF activity in cardiac differentiation. Importantly, they demonstrate that Smarcd3b and Gata5 can induce a primitive, CPC-like state.