Permeability is a measure of the degree to which cells can transport molecules across biological barriers. Units of permeability are distance per unit time (typically cm/s), where accurate measurements are needed to define drug delivery in homeostasis and to model dysfunction occurring during disease. This perspective offers a set of community-led guidelines to benchmark permeability data across multidisciplinary approaches and different biological contexts. First, we lay out the analytical framework for three methodologies to calculate permeability: in silico assays using either transition-based counting or the inhomogeneous-solubility diffusion approaches, in vitro permeability assays using cells cultured in 2D or 3D geometries, and in vivo assays utilizing in situ brain perfusion or multiple time-point regression analysis. Then, we demonstrate a systematic benchmarking of in silico to both in vitro and in vivo, depicting the ways in which each benchmarking is sensitive to the choices of assay design. Finally, we outline seven recommendations for best practices in permeability benchmarking and underscore the significance of tailored permeability assays in driving advancements in drug delivery research and development. Our exploration encompasses a discussion of "generic" and tissue-specific biological barriers, including the blood-brain barrier (BBB), which is a major hurdle for the delivery of therapeutic agents into the brain. By addressing challenges in reconciling simulated data with experimental assays, we aim to provide insights essential for optimizing accuracy and reliability in permeability modeling.