The level of stromal tumor-infiltrating lymphocytes (sTILs) in triple-negative (TNBC) and HER2-positive breast cancers convey prognostic information. The importance of systemic immunity to local immunity is unknown in breast cancer. We previously demonstrated that histological alterations in axillary lymph nodes (LNs) carry clinical relevance. Here, we capture local immune responses by scoring TILs at the primary tumor and systemic immune responses by recording the formation of secondary follicles, also known as germinal centers, in 2,857 cancer-free and involved axillary LNs on haematoxylin and eosin (H&E) stained sections from a retrospective cohort of 161 LN-positive triple-negative and HER2-positive breast cancer patients. Our data demonstrate that the number of germinal center formations across all cancer-free LNs, similar to high levels of TILs, is associated with a good prognosis in low TILs TNBC. This highlights the importance of assessing both primary and LN immune responses for prognostication and for future breast cancer research.