An important property of NEMO, the core element of the IKK complex involved in NF-kappaB activation, resides in its ability to specifically recognize poly-ubiquitin chains. A small domain called NOA/UBAN has been suggested to be responsible for this property. We recently demonstrated that the C-terminal Zinc Finger (ZF) of NEMO is also able to bind ubiquitin. We show here by ZF swapping and mutagenesis that this represents its only function. While neither NOA nor ZF shows any preference for K63-linked chains, we demonstrate that together they form a bipartite high-affinity K63-specific ubiquitin-binding domain. A similar domain can be found in two other proteins, Optineurin and ABIN2, and can be freely exchanged with that of NEMO without interfering with its activity. This suggests that the main function of the C-terminal half of NEMO is to specifically bind K63-linked poly-ubiquitin chains. We also demonstrate that the recently described binding of NEMO to linear poly-ubiquitin chains is dependent on the NOA alone and does not require the presence of the ZF.