An implementation evaluation of a sports-based health intervention for underrepresented middle school youth in Philadelphia

Transl Behav Med. 2024 Oct 6;14(10):588-597. doi: 10.1093/tbm/ibae039.

Abstract

Multicomponent, community-based programs aiming to improve health behaviors in youth are needed but can be challenging to implement. Research is needed to better understand the factors that facilitate and inhibit effective implementation of these programs especially for youth at increased risk of health disparities. This study aimed to identify and explore the implementation determinants and outcomes of a multicomponent health intervention conducted from 2021 to 2022 for middle school students living in underserved communities in Philadelphia, PA, USA. Mixed methods approaches, including self-report surveys and semi-structured qualitative interviews, were administered to 18 members of the implementation staff at the end of the program, including coaches (n = 7), assistant coaches (n = 2), school champions (n = 6), administrative leaders (n = 2), and a school district administrator (n = 1). Survey and interview questions were guided by the Consolidated Framework for Implementation Research (CFIR), and interviews were thematically coded following transcription based on 26 CFIR constructs. Innovation source, evidence strength and quality, cosmopolitanism, and the personal attributes of individuals were key constructs associated with implementation effectiveness. Data revealed three multidimensional themes that highlighted broader challenges influencing implementation: (i) broad consensus, different interpretations, (ii) staffing challenges, and (iii) continuity is key. The need for the program was clearly recognized and overall belief in the purpose of the intervention was strong among key program staff and administration. However, issues including limited engagement with training, staffing turnover, and the rotational programming design hindered implementation. Future projects aiming to implement multicomponent after-school time interventions must ensure a consistent vision among partners and continuity in program delivery.

Keywords: behavioral intervention; health equity; implementation; physical activity.

Plain language summary

There is a pressing need for effective interventions to improve health behaviors in youth and schools are ideal settings for this work. The needs are even greater in underresourced school settings where youth have limited access to sports and physical activity. However, implementing multicomponent sports-based programs can be challenging and this leads to inconsistencies in program delivery and effectiveness. Therefore, understanding the factors that support or inhibit program implementation in schools is of great public health importance. This study aimed to evaluate the factors impacting the implementation of an after-school sport-based intervention for youth at five middle schools in Philadelphia, PA, USA. Interviews and surveys were conducted with all programming staff at the end of the program, guided by the Consolidated Framework for Implementation Research (CFIR). Program staff highlighted the need for and importance of the program, but also identified that staffing and training, variability in approaches used, and a lack of consistent support for students were key issues that affected program success. Future programs should focus efforts and resources on hiring and training staff and providing support and consistency for youth to improve the implementation of these important programs in school settings.

MeSH terms

  • Adolescent
  • Child
  • Female
  • Health Behavior
  • Health Promotion / methods
  • Humans
  • Male
  • Minority Groups
  • Philadelphia
  • Program Evaluation*
  • School Health Services
  • Schools
  • Sports