In this paper we present a robust method for segmenting and tracking cardiac contours and tags in 4D cardiac MRI tagged images via spatio-temporal propagation. Our method is based on two main techniques: the Metamorphs segmentation for robust boundary estimation, and the tunable Gabor filter bank for tagging lines enhancement, removal and myocardium tracking. We have developed a prototype system based on the integration of these two techniques, and achieved efficient, robust segmentation and tracking with minimal human interaction.