Faculty Online Teaching Effectiveness Scale (FOTES): Instrument development and content validation

Eval Program Plann. 2024 Oct:106:102474. doi: 10.1016/j.evalprogplan.2024.102474. Epub 2024 Aug 8.

Abstract

This study aimed to develop and psychometrically test the Faculty Online Teaching Effectiveness Scale (FOTES) based upon both student and faculty perspectives of online teaching and learning in higher education. Online teaching effectiveness is a crucial component of quality education, but it has not been well-defined conceptually, and few studies have been conducted, using relevant domains, to accurately measure online teaching effectiveness. The impact of online course delivery on teaching effectiveness remains unclear. An exploratory sequential mixed methods design was employed with three phases of instrument development and psychometric testing. The FOTES comprises 50 items in seven domains: teaching philosophy, self-efficacy, relationships, course content, learning activities, teaching practices, and satisfaction. The instrument underwent initial testing, yielding positive expert appraisals with good-excellent psychometrics. All domains of the scale were significantly correlated, except for teaching philosophy. The preliminary results of the FOTES provide the empirical evidence to advance additional psychometric validation. This newly developed instrument has the potential to enhance faculty capacity and skill in self-evaluating their teaching effectiveness in online courses, providing a valid and reliable measure. The resulting instrument is poised to promote outcome evaluation and strengthen teaching and learning processes.

Keywords: Content validity; Effective teaching; Instrument development; Online teaching effectiveness; Psychometric validation; Self-evaluation of online teaching effectiveness.

Publication types

  • Validation Study

MeSH terms

  • Adult
  • Education, Distance
  • Faculty*
  • Female
  • Humans
  • Internet
  • Male
  • Program Evaluation / methods
  • Psychometrics*
  • Reproducibility of Results
  • Self Efficacy*
  • Surveys and Questionnaires
  • Teaching* / standards