Vibrationally-resolved resonant inelastic X-ray scattering (VR-RIXS) at the O K-edge is emerging as a powerful tool for identifying embedded molecules in lithium-ion battery cathodes. Here, we investigate two known oxygen redox-active cathode materials: the commercial LixNi0.90Co0.05Al0.05O2 (NCA) used in electric vehicles and the high-capacity cathode material Li1.2Ni0.13Co0.13Mn0.54O2 (LRNMC) for next-generation Li-ion batteries. We report the detection of a novel vibrational RIXS signature for Li-ion battery cathodes appearing in the O K pre-peak above 533 eV that we attribute to OH-groups. We discuss likely locations and pathways for OH-group formation and accumulation throughout the active cathode material. Initial-cycle behaviour for LRNMC shows that OH-signal strength correlates with the cathodes state of charge, though reversibility is incomplete. The OH-group RIXS signal strength in long-term cycled NCA is retained. Thus, VR-RIXS offers a path for gaining new insights to oxygen reactions in battery materials.