Absorption spectroscopy probing transitions from shallow-core d and f orbitals in lanthanides and actinides reveals information about bonding and the electronic structure in compounds containing these elements. However, spectroscopy in this photon energy range is challenging because of the limited availability of light sources and extremely short penetration depths. In this work, we address these challenges using a tabletop extreme ultraviolet (XUV), ultrafast, laser-driven, high harmonic generation light source, which generates femtosecond pulses in the 40-140 eV range. We present reflection spectroscopy measurements at the N4,5 (i.e., predominantly 4d to 5f transitions) and O4,5 (i.e., 5d to 5f transitions) absorption edges on several lanthanide and uranium oxide crystals. We compare these results to density functional theory calculations to assign the electronic transitions and predict the spectra for other lanthanides. This work paves the way for laboratory-scale XUV absorption experiments for studying crystalline and molecular f-electron systems, with applications ranging from surface chemistry, photochemistry, and electronic or chemical structure determination to nuclear forensics.