The goal of any vaccine is to induce long-lived plasma cells (LLPC) to provide life-long protection. Natural infection by influenza, measles, or mumps viruses generates bone marrow (BM) LLPC similar to tetanus vaccination which affords safeguards for decades. Although the SARS-CoV-2 mRNA vaccines protect from severe disease, the serologic half-life is short-lived even though SARS-CoV-2-specific plasma cells can be found in the BM. To better understand this paradox, we enrolled 19 healthy adults at 1.5-33 months after SARS-CoV-2 mRNA vaccine and measured influenza-, tetanus-, or SARS-CoV-2-specific antibody secreting cells (ASC) in LLPC (CD19 - ) and non-LLPC (CD19 + ) subsets within the BM. All individuals had IgG ASC specific for influenza, tetanus, and SARS-CoV-2 in at least one BM ASC compartment. However, only influenza- and tetanus-specific ASC were readily detected in the LLPC whereas SARS-CoV-2 specificities were mostly excluded. The ratios of non-LLPC:LLPC for influenza, tetanus, and SARS-CoV-2 were 0.61, 0.44, and 29.07, respectively. Even in five patients with known PCR-proven history of infection and vaccination, SARS-CoV-2-specific ASC were mostly excluded from the LLPC. These specificities were further validated by using multiplex bead binding assays of secreted antibodies in the supernatants of cultured ASC. Similarly, the IgG ratios of non-LLPC:LLPC for influenza, tetanus, and SARS-CoV-2 were 0.66, 0.44, and 23.26, respectively. In all, our studies demonstrate that rapid waning of serum antibodies is accounted for by the inability of mRNA vaccines to induce BM LLPC.