We investigate the properties of a measure of interrater agreement originally proposed by Rogot and Goldberg. Unlike commonly used measures, this measure not only adjusts for chance agreement, but it also standardizes for both perfect agreement as well as for perfect disagreement. Further, one can also use this measure to assess category specific conditional agreement, and thus apply it to situations with missing main diagonal data. We provide an asymptotic method for inference with this measure.