Dimerized quantum magnets are exotic crystalline materials where Bose-Einstein condensation of magnetic excitations can happen. However, known dimerized quantum magnets are limited to only a few oxides and halides. Here, we unveil 9 dimerized quantum magnets and 11 conventional antiferromagnets in ternary metal borides MTB4 (M = Sc, Y, La, Ce, Lu, Mg, Ca, and Al; T = V, Cr, Mn, Fe, Co, and Ni), where T atoms are arranged in structural dimers. Quantum magnetism in these compounds is dominated by strong antiferromagnetic (AFM) interactions between Cr (Cr and Mn for M = Mg and Ca) atoms within the dimers, with much weaker interactions between the dimers. These systems are proposed to be close to a quantum critical point between a disordered singlet spin-dimer phase, with a spin gap, and the ordered conventional Néel AFM phase. They greatly enrich the materials inventory that allows investigations of the spin-gap phase. Conventional antiferromagnetism in these compounds is dominated by ferromagnetic Mn (Fe for M = Mg and Ca) interactions within the dimers. The predicted stable and nonmagnetic (NM) YFeB4 phase is synthesized and characterized, providing a scarce candidate to study Fe dimers and Fe ladders in borides. The identified quantum, conventional, and NM systems provide a platform with abundant possibilities to tune the magnetic exchange coupling by doping and study the unconventional quantum phase transition and conventional magnetic transitions. This work opens new avenues for studying novel magnetism in borides arising from spin dimers and establishes a theoretical workflow for future searches for dimerized quantum magnets in other families of materials.