Hypotheses on a tree: new error rates and testing strategies

Biometrika. 2021 Sep;108(3):575-590. doi: 10.1093/biomet/asaa086. Epub 2020 Oct 14.

Abstract

We introduce a multiple testing procedure that controls global error rates at multiple levels of resolution. Conceptually, we frame this problem as the selection of hypotheses that are organized hierarchically in a tree structure. We describe a fast algorithm and prove that it controls relevant error rates given certain assumptions on the dependence between the p-values. Through simulations, we demonstrate that the proposed procedure provides the desired guarantees under a range of dependency structures and that it has the potential to gain power over alternative methods. Finally, we apply the method to studies on the genetic regulation of gene expression across multiple tissues and on the relation between the gut microbiome and colorectal cancer.

Keywords: False discovery rate; Hierarchical testing; Multiple testing; Selective inference.