Introduction: Efforts to ensure success of pharmacy students in passing pharmacy standardized exams require substantial investments. Engaging students effectively can be a challenge when there are no consequences for non-participation or poor performance. This study examined how engagement reinforcement, including high-stake exam requirements, instructional strategies, and incentives, impacted student performance on the Pharmacy Curriculum Outcomes Assessment (PCOA).
Methods: PCOA scores, milestone exams, grade point averages (GPAs), and PCOA preparedness assessments for cohorts (Co) that received high-stakes exams, incentives, and preparation (Co2019, Co2020, and Co2021) was compared with those that did not receive these interventions (Co2017 and Co2018). Students' perceptions regarding reinforcement, incentive, and preparedness were evaluated using an anonymous survey.
Results: Analyzing data from 545 students over five years, mandated PCOA preparedness, high-stakes PCOA requirements, and incentives for Co2019, Co2020, and Co2021 improved scores by 11% to 18% compared to Co2017 and Co2018. This corresponded to a rise in performance from the 12th to 27th percentile for Co2017 and Co2018 to the 39th to 49th percentile for Co2019, Co2020, and Co2021. In these later cohorts, PCOA scores consistently correlated with the school's milestone exams and students' cumulative GPAs (correlation coefficients 0.47-0.70, P < .001), while no such correlation was observed in Co2017 and Co2018. Faculty-led PCOA preparation yielded better results (48.2% in Co2020, 45.8% in Co2021) than self-learning (42% in Co2019). Students using faculty-prepared assessments reported increased confidence in biomedical and pharmaceutical sciences.
Conclusions: This study highlights the importance of high-stakes requirements, incentives, and thorough preparation in improving PCOA results.
Keywords: Assessment; Evaluation; PCOA; Performance; Test; Validity.
Copyright © 2023 Elsevier Inc. All rights reserved.