We report a patient with brain metastasis of rectal cancer who underwent metastatic tumor resection 3 times. In March 2012, a 76-years-old man, diagnosed with Stage III a rectal cancer, underwent Hartmann's operation. The lung metastasis was confirmed in July and November 2013, surgical resection for pulmonary metastasis was performed 2 times. In January 2016, he had difficulty of speaking, and isolated brain tumor was found. We performed surgical resection of brain metastasis in February 2016. In March and July 2016, the gamma knife radiosurgery was performed for other brain metastasis. In July 2016, he occurred nausea, headache and right identity hemi-blindness. Two new brain tumors were revealed. We performed surgical resection again. Three months after second brain surgery, he had dysarthria and a solitary brain tumor was confirmed. We performed third neurosurgical resection. All tumors of brain were found to be metastasis from rectal cancer in histological study. Currently, 16 months have passed since the first diagnosis of brain metastasis of this patient, and the quality of life was good relatively. The prognosis of the patients with brain metastasis is poor generally. However, this case suggested that multiple surgical resection of brain metastasis could improve prognosis and quality of life of patients. Accumulation of further cases is needed.