1-(Gamma-substituted prolyl)-(S)-2-cyanopyrrolidines were designed based on the predicted binding mode of the known DPP-IV inhibitor NVP-DPP728 and evaluated for their inhibitory activity. In structure-activity relationship study at the gamma-position of proline, it became clear that compounds bearing (S)-stereochemistry were 20-fold more potent than the antipode. Of these compounds, the (3,4-dicyanophenyl)amino- and (3-chloro-4-cyanophenyl)amino-derivatives showed the highest inhibitory activity.