Early detection of the existence or absence of the treatment effect: A cumulative meta-analysis

J Clin Epidemiol. 2020 Aug:124:24-33. doi: 10.1016/j.jclinepi.2020.04.006. Epub 2020 Apr 13.

Abstract

Objectives: An unexpected promising effect of low molecular weight heparins (LMWHs) on survival in patients with cancer was observed in early trials in post hoc subgroup analyses but not found in more recent trials. To highlight a possible regression over time toward the lack of the antitumoral effect of LMWHs, we performed a cumulative meta-analysis of survival data from randomized controlled trials (RCTs).

Study design and setting: Medical databases were searched to identify RCTs comparing, in patients with cancer, LMWHs with placebo or no treatment in patients free of venous thromboembolism (VTE), or to vitamin K antagonists in patients who experienced an acute VTE in overall survival. The cumulative hazard ratio (HR) was estimated after each study inclusion in chronological order.

Results: Twenty-three studies (12,970 patients) were included. The cumulative meta-analysis of the earlier trials showed a significant improvement in overall survival with LMWHs. This apparent benefit then gradually regressed over time toward an absence of the effect of LMWHs on survival (HR: 0.98 [95% confidence interval, 0.93; 1.03]).

Conclusion: Despite supportive experimental data and early clinical findings, the promising antitumoral effect of LMWHs in patients with cancer gradually vanished over time toward a lack of impact on overall survival. This result suggests 'p-hacking' and selective reporting of the positive results from post hoc subgroup analyses in the early studies.

Keywords: Cancer; Cumulative meta-analysis; Low molecular weight heparin; Randomized controlled trial; Survival; p-hacking.

Publication types

  • Meta-Analysis
  • Review

MeSH terms

  • Anticoagulants / therapeutic use*
  • Heparin, Low-Molecular-Weight / therapeutic use*
  • Humans
  • Neoplasms / complications*
  • Randomized Controlled Trials as Topic
  • Survival Analysis
  • Treatment Outcome
  • Venous Thromboembolism / complications*
  • Venous Thromboembolism / prevention & control*

Substances

  • Anticoagulants
  • Heparin, Low-Molecular-Weight