We use photoluminescence (PL) imaging to study damage growth precursors within laser damage sites on the surface of silica. Damage site evolution is induced by multiple shots of UV nanosecond pulsed laser at various energy densities and monitored throughout the early stages of growth. Wide-field PL imaging rapidly locates microscopic light absorption centers within the silica damage site. Our quantitative analysis shows that damage sites with strong local PL intensity show a higher probability of growth upon subsequent laser pulses. Scanning electron microscopy (SEM) paired with a study of PL spectrum shows that the strong PL intensity appears from the subsurface fractures with high defect density, which provides a local light absorption center leading to significant damage growth. We believe that this result offers an efficient optical damage mitigation strategy by providing a rapid and non-destructive optical inspection approach.