We systematically compare X-ray structures of inhibitor complexes of four well-known enzymes and correlate two- and three-dimensional (2D and 3D) similarity of inhibitors with their potency. The analysis reveals the presence of unexpected systematic relationships between molecular similarity and potency. These findings explain why apparently inconsistent structure-activity relationships (SARs) can coexist in different targets, and they have general implications for compound screening and optimization. The results suggest that (1) even for active sites with significant binding constraints, there is a high probability that structurally diverse ligands with similar activity can be identified, (2) different types of SARs are not mutually exclusive, and (3) the chemical nature of ligands is of comparable importance for SARs as the features of active sites. These insights aid in the understanding of target-specific SARs and their intrinsic degree of variability.