Increasingly, clinicians and researchers recognize that studies of interventions need to evaluate not only their therapeutic efficacy (i.e., the effect on an outcome in ideal, controlled settings) but also their real-world effectiveness in broad, unselected patient groups. Effectiveness trials inform clinical practice by comparing variations in therapeutic approaches that fall within the standard of care. In this article, we discuss the need for studies of comparative effectiveness in anesthesia and the limitations of individual patient randomized-controlled trials in determining comparative effectiveness. We introduce the concept of randomized cluster crossover trials as a means of answering questions of comparative effectiveness in anesthesia, using the design of the Benzodiazepine-Free Cardiac Anesthesia for Reduction in Postoperative Delirium (B-Free) trial (Clinicaltrials.gov identifier NCT03053869).