We demonstrate how multimode 2D IR spectroscopy of the protein amide I' and II' vibrations can be used to distinguish protein secondary structure. Polarization-dependent amide I'-II' 2D IR experiments on poly-l-lysine in the beta-sheet, alpha-helix, and random coil conformations show that a combination of amide I' and II' diagonal and cross peaks can effectively distinguish between secondary structural content, where amide I' infrared spectroscopy alone cannot. The enhanced sensitivity arises from frequency and amplitude correlations between amide II' and amide I' spectra that reflect the symmetry of secondary structures. 2D IR surfaces are used to parametrize an excitonic model for the amide I'-II' manifold suitable to predict protein amide I'-II' spectra. This model reveals that the dominant vibrational interaction contributing to this sensitivity is a combination of negative amide II'-II' through-bond coupling and amide I'-II' coupling within the peptide unit. The empirically determined amide II'-II' couplings do not significantly vary with secondary structure: -8.5 cm(-1) for the beta sheet, -8.7 cm(-1) for the alpha helix, and -5 cm(-1) for the coil.