The patient was a man in his 70s who visited our hospital to undergo an examination for fecal occult blood, which detected a 20 mm, Ⅱa lesion in the lower rectum on colonoscopy. He was diagnosed with SM-invasive cancer and was planned to undergo trans-anal local excision. After the surgery, he had a good postoperative course without complications. The pathological findings were Ⅱa, tub1, 22×16 mm, pT1a(950 mm), int, INF a, ly0, v0, pHM0, pVM0(300 mm). He was followed up after the surgery, but was diagnosed with lateral lymph node recurrence 4 years after a local surgery. The surgery involved right-sided lateral lymphadenectomy with resection of the ureter, spermatic duct, seminal vesicle, and piriformis muscle. He was diagnosed with lymph node metastasis with invasion of the spermatic duct based on pathology. Eight courses of adjuvant chemotherapy containing CapeOX was administered. Unfortunately, primary squamous cell lung cancer was detected, and he died after surgery for recurrence in the second year. It is suggested that it is necessary to note lateral lymph node recurrence on postoperative follow-up for lower rectal cancer at any stage.