X-ray crystal diffraction has provided atomic-level structural information on biological macromolecules. Data quality determines the reliability of structural models. In most cases, multiple data sets are available from different crystals and/or collected with different experimental settings. Reliable metrics are critical to rank and select the data set with the highest quality. Many measures have been created or modified for data quality evaluation. However, some are duplicate in functionality, and some are likely misused due to misunderstanding, which causes confusion or problems, especially at synchrotron beamlines where experiments proceed quickly. In this work, these measures are studied through both theoretical analysis and experimental data with various characteristics, which demonstrated that: 1). {Rmerg, Rmeas, Rpim, CC1/2} all measure the equivalence of reflections, and the low-shell values of these metrics can be used as reliable indicators for correctness (or trueness) of Laue symmetry; 2). High-shell I/σI is a reliable and better indicator to select resolution cutoff while the overall value measures the overall strength of the data.