Non-homologous end joining (NHEJ) is a major pathway to repair DNA double-strand breaks (DSBs), which can display different types of broken ends. However, it is unclear how NHEJ factors organize to repair diverse types of DNA breaks. Here, through systematic analysis of the human NHEJ factor interactome, we identify PAXX as a direct interactor of Ku. The crystal structure of PAXX is similar to those of XRCC4 and XLF. Importantly, PAXX-deficient cells are sensitive to DSB-causing agents. Moreover, epistasis analysis demonstrates that PAXX functions together with XLF in response to ionizing radiation-induced complex DSBs, whereas they function redundantly in response to Topo2 inhibitor-induced simple DSBs. Consistently, PAXX and XLF coordinately promote the ligation of complex but not simple DNA ends in vitro. Altogether, our data identify PAXX as a new NHEJ factor and provide insight regarding the organization of NHEJ factors responding to diverse types of DSB ends.