Practice misalignments in randomized controlled trials: Identification, impact, and potential solutions

Anesth Analg. 2010 Aug;111(2):444-50. doi: 10.1213/ane.0b013e3181aa8903.

Abstract

Appropriate control group selection in a randomized controlled trial (RCT) is a critical factor in generating results, which are both interpretable and generalizable. Control groups ideally encompass and realistically reflect prevailing medical practices. This goal can be challenging in investigations of standard therapies that are routinely titrated. To eliminate the heterogeneity in clinical practice from the trial design, recent investigations of titrated therapies have randomized patients to fixed-dose regimens. Although this approach may produce statistically significant differences, the results may not be interpretable or generalizable. In this trial design, randomization disrupts the normal relationship between clinically important characteristics and therapy titration, thereby creating subgroups of patients within each study arm that receive levels of therapy inconsistent with current practices outside of the clinical study. These misaligned subgroups may have worse outcomes than usual care. Practice misalignments can occur in any clinical trial of a preexisting therapy that is typically adjusted based on severity of illness or other patient characteristics. In this study, we review three recent RCTs to demonstrate how practice misalignments can affect the safety, results, and conclusions of RCTs. Furthermore, we discuss methods to prospectively identify potentially important relationships between therapy titration and patient- and disease-specific characteristics. Finally, we review trial design options that may minimize the occurrence and impact of practice misalignments. Because these designs may limit the feasibility of a clinical trial, a thorough characterization of usual care is necessary to determine whether one of these designs should be used to protect patient safety.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, N.I.H., Intramural
  • Review

MeSH terms

  • Blood Transfusion
  • Control Groups*
  • Critical Care*
  • Critical Illness*
  • Evidence-Based Medicine
  • Humans
  • Opioid-Related Disorders / therapy
  • Patient Selection*
  • Practice Guidelines as Topic
  • Randomized Controlled Trials as Topic / methods*
  • Reproducibility of Results
  • Respiration, Artificial / methods
  • Respiratory Distress Syndrome / physiopathology
  • Respiratory Distress Syndrome / therapy
  • Safety
  • Severity of Illness Index
  • Tidal Volume
  • Treatment Outcome