-
Scaling convolutional neural networks achieves expert-level seizure detection in neonatal EEG
Authors:
Robert Hogan,
Sean R. Mathieson,
Aurel Luca,
Soraia Ventura,
Sean Griffin,
Geraldine B. Boylan,
John M. O'Toole
Abstract:
Background: Neonatal seizures are a neurological emergency that require urgent treatment. They are hard to diagnose clinically and can go undetected if EEG monitoring is unavailable. EEG interpretation requires specialised expertise which is not widely available. Algorithms to detect EEG seizures can address this limitation but have yet to reach widespread clinical adoption.
Methods: Retrospecti…
▽ More
Background: Neonatal seizures are a neurological emergency that require urgent treatment. They are hard to diagnose clinically and can go undetected if EEG monitoring is unavailable. EEG interpretation requires specialised expertise which is not widely available. Algorithms to detect EEG seizures can address this limitation but have yet to reach widespread clinical adoption.
Methods: Retrospective EEG data from 332 neonates was used to develop and validate a seizure-detection model. The model was trained and tested with a development dataset ($n=202$) that was annotated with over 12k seizure events on a per-channel basis. This dataset was used to develop a convolutional neural network (CNN) using a modern architecture and training methods. The final model was then validated on two independent multi-reviewer datasets ($n=51$ and $n=79$).
Results: Increasing dataset and model size improved model performance: Matthews correlation coefficient (MCC) and Pearson's correlation ($r$) increased by up to 50% with data scaling and up to 15% with model scaling. Over 50k hours of annotated single-channel EEG was used for training a model with 21 million parameters. State-of-the-art was achieved on an open-access dataset (MCC=0.764, $r=0.824$, and AUC=0.982). The CNN attains expert-level performance on both held-out validation sets, with no significant difference in inter-rater agreement among the experts and among experts and algorithm ($Δκ< -0.095$, $p>0.05$).
Conclusion: With orders of magnitude increases in data and model scale we have produced a new state-of-the-art model for neonatal seizure detection. Expert-level equivalence on completely unseen data, a first in this field, provides a strong indication that the model is ready for further clinical validation.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
Neonatal EEG graded for severity of background abnormalities in hypoxic-ischaemic encephalopathy
Authors:
John M O'Toole,
Sean R Mathieson,
Sumit A Raurale,
Fabio Magarelli,
William P Marnane,
Gordon Lightbody,
Geraldine B Boylan
Abstract:
This report describes a set of neonatal electroencephalogram (EEG) recordings graded according to the severity of abnormalities in the background pattern. The dataset consists of 169 hours of multichannel EEG from 53 neonates recorded in a neonatal intensive care unit. All neonates received a diagnosis of hypoxic-ischaemic encephalopathy (HIE), the most common cause of brain injury in full term in…
▽ More
This report describes a set of neonatal electroencephalogram (EEG) recordings graded according to the severity of abnormalities in the background pattern. The dataset consists of 169 hours of multichannel EEG from 53 neonates recorded in a neonatal intensive care unit. All neonates received a diagnosis of hypoxic-ischaemic encephalopathy (HIE), the most common cause of brain injury in full term infants. For each neonate, multiple 1-hour epochs of good quality EEG were selected and then graded for background abnormalities. The grading system assesses EEG attributes such as amplitude and frequency, continuity, sleep--wake cycling, symmetry and synchrony, and abnormal waveforms. Background severity was then categorised into 4 grades: normal or mildly abnormal EEG, moderately abnormal EEG, severely abnormal EEG, and inactive EEG. The data can be used as a reference set of multi-channel EEG for neonates with HIE, for EEG training purposes, or for developing and evaluating automated grading algorithms.
△ Less
Submitted 23 December, 2022; v1 submitted 9 June, 2022;
originally announced June 2022.
-
Classification of fetal compromise during labour: signal processing and feature engineering of the cardiotocograph
Authors:
M. O'Sullivan,
T. Gabruseva,
G. Boylan,
M. O'Riordan,
G. Lightbody,
W. Marnane
Abstract:
Cardiotocography (CTG) is the main tool used for fetal monitoring during labour. Interpretation of CTG requires dynamic pattern recognition in real time. It is recognised as a difficult task with high inter- and intra-observer disagreement. Machine learning has provided a viable path towards objective and reliable CTG assessment. In this study, novel CTG features are developed based on clinical ex…
▽ More
Cardiotocography (CTG) is the main tool used for fetal monitoring during labour. Interpretation of CTG requires dynamic pattern recognition in real time. It is recognised as a difficult task with high inter- and intra-observer disagreement. Machine learning has provided a viable path towards objective and reliable CTG assessment. In this study, novel CTG features are developed based on clinical expertise and system control theory using an autoregressive moving-average (ARMA) model to characterise the response of the fetal heart rate to contractions. The features are evaluated in a machine learning model to assess their efficacy in identifying fetal compromise. ARMA features ranked amongst the top features for detecting fetal compromise. Additionally, including clinical factors in the machine learning model and pruning data based on a signal quality measure improved the performance of the classifier.
△ Less
Submitted 31 October, 2021;
originally announced November 2021.
-
Deep Learning for EEG Seizure Detection in Preterm Infants
Authors:
Alison OShea,
Rehan Ahmed,
Gordon Lightbody,
Sean Mathieson,
Elena Pavlidis,
Rhodri Lloyd,
Francesco Pisani,
Willian Marnane,
Geraldine Boylan,
Andriy Temko
Abstract:
EEG is the gold standard for seizure detection in the newborn infant, but EEG interpretation in the preterm group is particularly challenging; trained experts are scarce and the task of interpreting EEG in real-time is arduous. Preterm infants are reported to have a higher incidence of seizures compared to term infants. Preterm EEG morphology differs from that of term infants, which implies that s…
▽ More
EEG is the gold standard for seizure detection in the newborn infant, but EEG interpretation in the preterm group is particularly challenging; trained experts are scarce and the task of interpreting EEG in real-time is arduous. Preterm infants are reported to have a higher incidence of seizures compared to term infants. Preterm EEG morphology differs from that of term infants, which implies that seizure detection algorithms trained on term EEG may not be appropriate. The task of developing preterm specific algorithms becomes extra-challenging given the limited amount of annotated preterm EEG data available. This paper explores novel deep learning (DL) architectures for the task of neonatal seizure detection in preterm infants. The study tests and compares several approaches to address the problem: training on data from full-term infants; training on data from preterm infants; training on age-specific preterm data and transfer learning. The system performance is assessed on a large database of continuous EEG recordings of 575h in duration. It is shown that the accuracy of a validated term-trained EEG seizure detection algorithm, based on a support vector machine classifier, when tested on preterm infants falls well short of the performance achieved for full-term infants. An AUC of 88.3% was obtained when tested on preterm EEG as compared to 96.6% obtained when tested on term EEG. When re-trained on preterm EEG, the performance marginally increases to 89.7%. An alternative DL approach shows a more stable trend when tested on the preterm cohort, starting with an AUC of 93.3% for the term-trained algorithm and reaching 95.0% by transfer learning from the term model using available preterm data.
△ Less
Submitted 28 May, 2021;
originally announced June 2021.
-
Neonatal seizure detection from raw multi-channel EEG using a fully convolutional architecture
Authors:
Alison O'Shea,
Gordon Lightbody,
Geraldine Boylan,
Andriy Temko
Abstract:
A deep learning classifier for detecting seizures in neonates is proposed. This architecture is designed to detect seizure events from raw electroencephalogram (EEG) signals as opposed to the state-of-the-art hand engineered feature-based representation employed in traditional machine learning based solutions. The seizure detection system utilises only convolutional layers in order to process the…
▽ More
A deep learning classifier for detecting seizures in neonates is proposed. This architecture is designed to detect seizure events from raw electroencephalogram (EEG) signals as opposed to the state-of-the-art hand engineered feature-based representation employed in traditional machine learning based solutions. The seizure detection system utilises only convolutional layers in order to process the multichannel time domain signal and is designed to exploit the large amount of weakly labelled data in the training stage. The system performance is assessed on a large database of continuous EEG recordings of 834h in duration; this is further validated on a held-out publicly available dataset and compared with two baseline SVM based systems.
The developed system achieves a 56% relative improvement with respect to a feature-based state-of-the art baseline, reaching an AUC of 98.5%; this also compares favourably both in terms of performance and run-time. The effect of varying architectural parameters is thoroughly studied. The performance improvement is achieved through novel architecture design which allows more efficient usage of available training data and end-to-end optimisation from the front-end feature extraction to the back-end classification. The proposed architecture opens new avenues for the application of deep learning to neonatal EEG, where the performance becomes a function of the amount of training data with less dependency on the availability of precise clinical labels.
△ Less
Submitted 28 May, 2021;
originally announced May 2021.
-
Estimation of Continuous Blood Pressure from PPG via a Federated Learning Approach
Authors:
Eoin Brophy,
Maarten De Vos,
Geraldine Boylan,
Tomas Ward
Abstract:
Ischemic heart disease is the highest cause of mortality globally each year. This not only puts a massive strain on the lives of those affected but also on the public healthcare systems. To understand the dynamics of the healthy and unhealthy heart doctors commonly use electrocardiogram (ECG) and blood pressure (BP) readings. These methods are often quite invasive, in particular when continuous ar…
▽ More
Ischemic heart disease is the highest cause of mortality globally each year. This not only puts a massive strain on the lives of those affected but also on the public healthcare systems. To understand the dynamics of the healthy and unhealthy heart doctors commonly use electrocardiogram (ECG) and blood pressure (BP) readings. These methods are often quite invasive, in particular when continuous arterial blood pressure (ABP) readings are taken and not to mention very costly. Using machine learning methods we seek to develop a framework that is capable of inferring ABP from a single optical photoplethysmogram (PPG) sensor alone. We train our framework across distributed models and data sources to mimic a large-scale distributed collaborative learning experiment that could be implemented across low-cost wearables. Our time series-to-time series generative adversarial network (T2TGAN) is capable of high-quality continuous ABP generation from a PPG signal with a mean error of 2.54 mmHg and a standard deviation of 23.7 mmHg when estimating mean arterial pressure on a previously unseen, noisy, independent dataset. To our knowledge, this framework is the first example of a GAN capable of continuous ABP generation from an input PPG signal that also uses a federated learning methodology.
△ Less
Submitted 24 February, 2021;
originally announced February 2021.
-
Grading the severity of hypoxic-ischemic encephalopathy in newborn EEG using a convolutional neural network
Authors:
Sumit A. Raurale,
Geraldine B. Boylan,
Gordon Lightbody,
John M. O'Toole
Abstract:
Electroencephalography (EEG) is a valuable clinical tool for grading injury caused by lack of blood and oxygen to the brain during birth. This study presents a novel end-to-end architecture, using a deep convolutional neural network, that learns hierarchical representations within raw EEG data. The system classifies 4 grades of hypoxic-ischemic encephalopathy and is evaluated on a multi-channel EE…
▽ More
Electroencephalography (EEG) is a valuable clinical tool for grading injury caused by lack of blood and oxygen to the brain during birth. This study presents a novel end-to-end architecture, using a deep convolutional neural network, that learns hierarchical representations within raw EEG data. The system classifies 4 grades of hypoxic-ischemic encephalopathy and is evaluated on a multi-channel EEG dataset of 63 hours from 54 newborns. The proposed method achieves a testing accuracy of 79.6% with one-step voting and 81.5% with two-step voting. These results show how a feature-free approach can be used to classify different grades of injury in newborn EEG with comparable accuracy to existing feature-based systems. Automated grading of newborn background EEG could help with the early identification of those infants in need of interventional therapies such as hypothermia.
△ Less
Submitted 12 May, 2020;
originally announced May 2020.
-
Identifying trace alternant activity in neonatal EEG using an inter-burst detection approach
Authors:
Sumit A. Raurale,
Geraldine B. Boylan,
Gordon Lightbody,
John M. O'Toole
Abstract:
Electroencephalography (EEG) is an important clinical tool for reviewing sleep-wake cycling in neonates in intensive care. Trace alternant (TA)-a characteristic pattern of EEG activity during quiet sleep in term neonates-is defined by alternating periods of short-duration, high-voltage activity (bursts) separated by lower-voltage activity (inter-bursts). This study presents a novel approach for de…
▽ More
Electroencephalography (EEG) is an important clinical tool for reviewing sleep-wake cycling in neonates in intensive care. Trace alternant (TA)-a characteristic pattern of EEG activity during quiet sleep in term neonates-is defined by alternating periods of short-duration, high-voltage activity (bursts) separated by lower-voltage activity (inter-bursts). This study presents a novel approach for detecting TA activity by first detecting the inter-bursts and then processing the temporal map of the bursts and inter-bursts. EEG recordings from 72 healthy term neonates were used to develop and evaluate performance of 1) an inter-burst detection method which is then used for 2) detection of TA activity. First, multiple amplitude and spectral features were combined using a support vector machine (SVM) to classify bursts from inter-bursts within TA activity, resulting in a median area under the operating characteristic curve (AUC) of 0.95 (95% confidence interval, CI: 0.93 to 0.98). Second, post-processing of the continuous SVM output, the confidence score, was used to produce a TA envelope. This envelope was used to detect TA activity within the continuous EEG with a median AUC of 0.84 (95% CI: 0.80 to 0.88). These results validate how an inter-burst detection approach combined with post processing can be used to classify TA activity. Detecting the presence or absence of TA will help quantify disruption of the clinically important sleep-wake cycle.
△ Less
Submitted 12 May, 2020;
originally announced May 2020.
-
Machine learning without a feature set for detecting bursts in the EEG of preterm infants
Authors:
John M. O'Toole,
Geraldine B. Boylan
Abstract:
Deep neural networks enable learning directly on the data without the domain knowledge needed to construct a feature set. This approach has been extremely successful in almost all machine learning applications. We propose a new framework that also learns directly from the data, without extracting a feature set. We apply this framework to detecting bursts in the EEG of premature infants. The EEG is…
▽ More
Deep neural networks enable learning directly on the data without the domain knowledge needed to construct a feature set. This approach has been extremely successful in almost all machine learning applications. We propose a new framework that also learns directly from the data, without extracting a feature set. We apply this framework to detecting bursts in the EEG of premature infants. The EEG is recorded within days of birth in a cohort of infants without significant brain injury and born <30 weeks of gestation. The method first transforms the time-domain signal to the time--frequency domain and then trains a machine learning method, a gradient boosting machine, on each time-slice of the time--frequency distribution. We control for oversampling the time--frequency distribution with a significant reduction (<1%) in memory and computational complexity. The proposed method achieves similar accuracy to an existing multi-feature approach: area under the characteristic curve of 0.98 (with 95% confidence interval of 0.96 to 0.99), with a median sensitivity of 95% and median specificity of 94%. The proposed framework presents an accurate, simple, and computational efficient implementation as an alternative to both the deep learning approach and to the manual generation of a feature set.
△ Less
Submitted 16 July, 2019;
originally announced July 2019.
-
Suitability of an inter-burst detection method for grading hypoxic-ischemic encephalopathy in newborn EEG
Authors:
Sumit A. Raurale,
Saif Nalband,
Geraldine B. Boylan,
Gordon Lightbody,
John M. O'Toole
Abstract:
Electroencephalography (EEG) is an important clinical tool for grading injury caused by lack of oxygen or blood to the brain during birth. Characteristics of low-voltage waveforms, known as inter-bursts, are related to different grades of injury. This study assesses the suitability of an existing inter-burst detection method, developed from preterm infants born <30 weeks of gestational age, to det…
▽ More
Electroencephalography (EEG) is an important clinical tool for grading injury caused by lack of oxygen or blood to the brain during birth. Characteristics of low-voltage waveforms, known as inter-bursts, are related to different grades of injury. This study assesses the suitability of an existing inter-burst detection method, developed from preterm infants born <30 weeks of gestational age, to detect inter-bursts in term infants. Different features from the temporal organisation of the inter-bursts are combined using a multi-layer perceptron (MLP) machine learning algorithm to classify four grades of injury in the EEG. We find that the best performing feature, percentage of inter-bursts, has an accuracy of 59.3%. Combining this with the maximum duration of inter-bursts in the MLP produces a testing accuracy of 77.8%, with similar performance to existing multi-feature methods. These results validate the use of the preterm detection method in term EEG and show how simple measures of the inter-burst interval can be used to classify different grades of injury.
△ Less
Submitted 5 July, 2019;
originally announced July 2019.
-
Neonatal EEG Interpretation and Decision Support Framework for Mobile Platforms
Authors:
Mark O'Sullivan,
Sergi Gomez,
Alison O'Shea,
Eduard Salgado,
Kevin Huillca,
Sean Mathieson,
Geraldine Boylan,
Emanuel Popovici,
Andriy Temko
Abstract:
This paper proposes and implements an intuitive and pervasive solution for neonatal EEG monitoring assisted by sonification and deep learning AI that provides information about neonatal brain health to all neonatal healthcare professionals, particularly those without EEG interpretation expertise. The system aims to increase the demographic of clinicians capable of diagnosing abnormalities in neona…
▽ More
This paper proposes and implements an intuitive and pervasive solution for neonatal EEG monitoring assisted by sonification and deep learning AI that provides information about neonatal brain health to all neonatal healthcare professionals, particularly those without EEG interpretation expertise. The system aims to increase the demographic of clinicians capable of diagnosing abnormalities in neonatal EEG. The proposed system uses a low-cost and low-power EEG acquisition system. An Android app provides single-channel EEG visualization, traffic-light indication of the presence of neonatal seizures provided by a trained, deep convolutional neural network and an algorithm for EEG sonification, designed to facilitate the perception of changes in EEG morphology specific to neonatal seizures. The multifaceted EEG interpretation framework is presented and the implemented mobile platform architecture is analyzed with respect to its power consumption and accuracy.
△ Less
Submitted 8 June, 2018;
originally announced June 2018.
-
On sound-based interpretation of neonatal EEG
Authors:
Sergi Gomez,
Mark O'Sullivan,
Emanuel Popovici,
Sean Mathieson,
Geraldine Boylan,
Andriy Temko
Abstract:
Significant training is required to visually interpret neonatal EEG signals. This study explores alternative sound-based methods for EEG interpretation which are designed to allow for intuitive and quick differentiation between healthy background activity and abnormal activity such as seizures. A novel method based on frequency and amplitude modulation (FM/AM) is presented. The algorithm is tuned…
▽ More
Significant training is required to visually interpret neonatal EEG signals. This study explores alternative sound-based methods for EEG interpretation which are designed to allow for intuitive and quick differentiation between healthy background activity and abnormal activity such as seizures. A novel method based on frequency and amplitude modulation (FM/AM) is presented. The algorithm is tuned to facilitate the audio domain perception of rhythmic activity which is specific to neonatal seizures. The method is compared with the previously developed phase vocoder algorithm for different time compressing factors. A survey is conducted amongst a cohort of non-EEG experts to quantitatively and qualitatively examine the performance of sound-based methods in comparison with the visual interpretation. It is shown that both sonification methods perform similarly well, with a smaller inter-observer variability in comparison with visual. A post-survey analysis of results is performed by examining the sensitivity of the ear to frequency evolution in audio.
△ Less
Submitted 8 June, 2018;
originally announced June 2018.
-
Investigating the Impact of CNN Depth on Neonatal Seizure Detection Performance
Authors:
Alison O'Shea,
Gordon Lightbody,
Geraldine Boylan,
Andriy Temko
Abstract:
This study presents a novel, deep, fully convolutional architecture which is optimized for the task of EEG-based neonatal seizure detection. Architectures of different depths were designed and tested; varying network depth impacts convolutional receptive fields and the corresponding learned feature complexity. Two deep convolutional networks are compared with a shallow SVM-based neonatal seizure d…
▽ More
This study presents a novel, deep, fully convolutional architecture which is optimized for the task of EEG-based neonatal seizure detection. Architectures of different depths were designed and tested; varying network depth impacts convolutional receptive fields and the corresponding learned feature complexity. Two deep convolutional networks are compared with a shallow SVM-based neonatal seizure detector, which relies on the extraction of hand-crafted features. On a large clinical dataset, of over 800 hours of multichannel unedited EEG, containing 1389 seizure events, the deep 11-layer architecture significantly outperforms the shallower architectures, improving the AUC90 from 82.6% to 86.8%. Combining the end-to-end deep architecture with the feature-based shallow SVM further improves the AUC90 to 87.6%. The fusion of classifiers of different depths gives greatly improved performance and reduced variability, making the combined classifier more clinically reliable.
△ Less
Submitted 8 June, 2018;
originally announced June 2018.
-
Neonatal Seizure Detection using Convolutional Neural Networks
Authors:
Alison O'Shea,
Gordon Lightbody,
Geraldine Boylan,
Andriy Temko
Abstract:
This study presents a novel end-to-end architecture that learns hierarchical representations from raw EEG data using fully convolutional deep neural networks for the task of neonatal seizure detection. The deep neural network acts as both feature extractor and classifier, allowing for end-to-end optimization of the seizure detector. The designed system is evaluated on a large dataset of continuous…
▽ More
This study presents a novel end-to-end architecture that learns hierarchical representations from raw EEG data using fully convolutional deep neural networks for the task of neonatal seizure detection. The deep neural network acts as both feature extractor and classifier, allowing for end-to-end optimization of the seizure detector. The designed system is evaluated on a large dataset of continuous unedited multi-channel neonatal EEG totaling 835 hours and comprising of 1389 seizures. The proposed deep architecture, with sample-level filters, achieves an accuracy that is comparable to the state-of-the-art SVM-based neonatal seizure detector, which operates on a set of carefully designed hand-crafted features. The fully convolutional architecture allows for the localization of EEG waveforms and patterns that result in high seizure probabilities for further clinical examination.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
