Performance standards improve American Board of Surgery In-Training Examination scores

Curr Surg. 2002 Mar-Apr;59(2):220-2. doi: 10.1016/s0149-7944(01)00621-3.

Abstract

Purpose: Although several studies have evaluated factors affecting American Board of Surgery In-Training Examination (ABSITE) performance, none has examined the impact of setting a minimally acceptable standard. It was hypothesized that establishing such a criterion would improve ABSITE scores.

Methods: An expectation for residents to score at the 35th percentile or higher was established in 1996. The proportion of test scores above or below the 35th and 50th percentiles for the time periods before and after institution of the standard were compared using Fisher's exact test. The subsequent performance of residents scoring below the 35th percentile was analyzed for the 2 time periods.

Results: After the institution of the standard, the proportion of scores below the 35th percentile decreased from 46.7% to 21.9% (p = 0.0005). Similarly, the proportion of scores at or above the national average increased from 42.1% to 65.6% (p = 0.0005). After establishing the standard, fewer residents continued to have scores below the criterion in subsequent years.

Conclusions: Establishing a performance criterion improved ABSITE scores. The decision to institute a standard must be individualized for each program. The rationale for the standard and a plan to assist residents failing to achieve the benchmark must be communicated.