An important challenge in the field of cancer is finding the balance between delivering effective treatments and avoiding adverse effects and financial toxicity caused by innovative, yet expensive, drugs. To address this, several treatment de-escalation trials have been conducted, but only a few of these have provided clear answers. A few trials had poor accrual or had design flaws that led to conflicting results. Members of the Breast International Group (BIG) and North American Breast Cancer Group (NABCG) believe the way forward is to understand the lessons from these trials and listen more carefully to what truly matters to our patients. We reviewed several adjuvant trials of different cancer types and developed a road map for improving the design and implementation of future de-escalation trials. The road map incorporates patients' insights obtained through focused group discussions across the BIG-NABCG networks. Considerations for the development of de-escalation trials for systemic adjuvant treatment, including noninferiority trial design, choice of end points, and prioritization of a patient's perspectives, are presented in this consensus article.