Photophysical image analysis: Unsupervised probabilistic thresholding for images from electron-multiplying charge-coupled devices

PLoS One. 2024 Apr 5;19(4):e0300122. doi: 10.1371/journal.pone.0300122. eCollection 2024.

Abstract

We introduce the concept photophysical image analysis (PIA) and an associated pipeline for unsupervised probabilistic image thresholding for images recorded by electron-multiplying charge-coupled device (EMCCD) cameras. We base our approach on a closed-form analytic expression for the characteristic function (Fourier-transform of the probability mass function) for the image counts recorded in an EMCCD camera, which takes into account both stochasticity in the arrival of photons at the imaging camera and subsequent noise induced by the detection system of the camera. The only assumption in our method is that the background photon arrival to the imaging system is described by a stationary Poisson process (we make no assumption about the photon statistics for the signal). We estimate the background photon statistics parameter, λbg, from an image which contains both background and signal pixels by use of a novel truncated fit procedure with an automatically determined image count threshold. Prior to this, the camera noise model parameters are estimated using a calibration step. Utilizing the estimates for the camera parameters and λbg, we then introduce a probabilistic thresholding method, where, for the first time, the fraction of misclassified pixels can be determined a priori for a general image in an unsupervised way. We use synthetic images to validate our a priori estimates and to benchmark against the Otsu method, which is a popular unsupervised non-probabilistic image thresholding method (no a priori estimates for the error rates are provided). For completeness, we lastly present a simple heuristic general-purpose segmentation method based on the thresholding results, which we apply to segmentation of synthetic images and experimental images of fluorescent beads and lung cell nuclei. Our publicly available software opens up for fully automated, unsupervised, probabilistic photophysical image analysis.

MeSH terms

  • Diagnostic Imaging*
  • Electrons*
  • Fourier Analysis
  • Image Processing, Computer-Assisted / methods

Grants and funding

T.A received funding from the Crafoord Foundation, grant number 20180675. J.O.T., J.B and O.S received funding from NanoLund, grant number staff01-2020. F.W. received financial support from The Swedish Childhood Cancer Fund (Barncancerfonden), grants PR2019-0037, PR2022-0014 and the Swedish Research Council (2022-03490). The computations were enabled by resources provided by the National Academic Infrastructure for Supercomputing in Sweden (NAISS) and the Swedish National Infrastructure for Computing (SNIC) at the national Supercomputing Centre at Link\"oping University partially funded by the Swedish Research Council through grant agreements no. 2022-06725 and no. 2018-05973. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.