Adapting situational judgment tests to the postgraduate year 1 pharmacy residency selection process at an academic medical center

Disclaimer: In an effort to expedite the publication of articles, AJHP is posting manuscripts online as soon as possible after acceptance. Accepted manuscripts have been peer-reviewed and copyedited, but are posted online before technical formatting and author proofing. These manuscripts are not the final version of record and will be replaced with the final article (formatted per AJHP style and proofed by the authors) at a later time.

Purpose: Evaluation methods for postgraduate year 1 (PGY1) pharmacy residency positions must objectively rank candidates and assess clinical and nonclinical characteristics. Situational judgment tests (SJTs), many of which have been shown to be both consistent and validated, were used as a structure for a new assessment adapted into our selection process to predict candidates' future success in our residency program. To our knowledge, no PGY1 pharmacy residency program has published its experience adapting an SJT in a live panel environment.

Summary: We formulated a modified SJT with 5 scenarios devised to judge 5 behavioral domains: communication, integrity, assertiveness, time management, and problem solving. These domains align with our organization's core values and the American Society of Health-System Pharmacists (ASHP) required competency areas, goals, and objectives (CAGOs) for PGY1 programs. Similarly, scenarios and responses attempted to reduce risk of bias and ensure measurement of relevant skills. These assessments were intended to expose patterns that suggested fear of authority, lack of awareness, aversion to confrontation, or carelessness. We also noted if candidates struggled to grasp and follow instructions, commit to answers, consider multiple facets of a decision, or defend their choice. This information was not assessed in other components of our current process.

Conclusion: Our modified SJTs and structured rubric assess candidate skills in a standardized manner. By evaluating a candidate's response and verbalized thought process in search of core values, we move away from using subjective "fit" and instead focus on specific characteristics we seek to nurture and develop in our future residents.