Progress in tuberculosis vaccine development is hampered by an incomplete understanding of the immune mechanisms that protect against infection with Mycobacterium tuberculosis (Mtb), the causative agent of tuberculosis. Although the M72/ASOE1 trial yielded encouraging results (54% efficacy in subjects with prior exposure to Mtb), a highly effective vaccine against adult tuberculosis remains elusive. We show that in a mouse model, establishment of a contained and persistent yet non-pathogenic infection with Mtb ("contained Mtb infection", CMTB) rapidly and durably reduces tuberculosis disease burden after re-exposure through aerosol challenge. Protection is associated with elevated activation of alveolar macrophages, the first cells that respond to inhaled Mtb, and accelerated recruitment of Mtb-specific T cells to the lung parenchyma. Systems approaches, as well as ex vivo functional assays and in vivo infection experiments, demonstrate that CMTB reconfigures tissue resident alveolar macrophages via low grade interferon-γ exposure. These studies demonstrate that under certain circumstances, the continuous interaction of the immune system with Mtb is beneficial to the host by maintaining elevated innate immune responses.