-
Accelerating Domain-Aware Electron Microscopy Analysis Using Deep Learning Models with Synthetic Data and Image-Wide Confidence Scoring
Authors:
Matthew J. Lynch,
Ryan Jacobs,
Gabriella Bruno,
Priyam Patki,
Dane Morgan,
Kevin G. Field
Abstract:
The integration of machine learning (ML) models enhances the efficiency, affordability, and reliability of feature detection in microscopy, yet their development and applicability are hindered by the dependency on scarce and often flawed manually labeled datasets and a lack of domain awareness. We addressed these challenges by creating a physics-based synthetic image and data generator, resulting…
▽ More
The integration of machine learning (ML) models enhances the efficiency, affordability, and reliability of feature detection in microscopy, yet their development and applicability are hindered by the dependency on scarce and often flawed manually labeled datasets and a lack of domain awareness. We addressed these challenges by creating a physics-based synthetic image and data generator, resulting in a machine learning model that achieves comparable precision (0.86), recall (0.63), F1 scores (0.71), and engineering property predictions (R2=0.82) to a model trained on human-labeled data. We enhanced both models by using feature prediction confidence scores to derive an image-wide confidence metric, enabling simple thresholding to eliminate ambiguous and out-of-domain images resulting in performance boosts of 5-30% with a filtering-out rate of 25%. Our study demonstrates that synthetic data can eliminate human reliance in ML and provides a means for domain awareness in cases where many feature detections per image are needed.
△ Less
Submitted 2 August, 2024;
originally announced August 2024.
-
MX precipitate behavior in an irradiated advanced Fe-9Cr steel: Helium effects on phase stability
Authors:
T. M. Kelsy Green,
Tim Graening,
Weicheng Zhong,
Ying Yang,
Kevin G. Field
Abstract:
Precipitates are main microstructural features to provide high temperature creep strength and radiation resistance in structural materials for fusion energy systems. However, the mechanisms of precipitate stability under irradiation in candidate structural materials for fusion first-wall and blanket components are poorly understood. In particular, the dual effects of helium transmutation and irrad…
▽ More
Precipitates are main microstructural features to provide high temperature creep strength and radiation resistance in structural materials for fusion energy systems. However, the mechanisms of precipitate stability under irradiation in candidate structural materials for fusion first-wall and blanket components are poorly understood. In particular, the dual effects of helium transmutation and irradiation-induced damage on precipitate evolution have not been systematically studied in candidate materials, the leading of which are Fe-9Cr reduced activation ferritic/martensitic (RAFM) alloys. To fill this knowledge gap, a fundamental understanding of the single and combined interactions of helium (0-25 appm He/dpa), temperature (300-600C), and atomic displacements (15-100 dpa) on the behavior of MX (M=metal, X=C and/or N) precipitates in an advanced Fe-9Cr RAFM alloy were studied through the use of dual ion irradiation experiments. It was found that helium suppressed the diffusion-mediated mechanisms of precipitate stability (i.e. radiation-enhanced growth) at elevated temperatures and intermediate damage levels but had no effect on precipitate dissolution in the high dose conditions (>50 dpa). A precipitate stability model was used to rationalize the impacts of helium on ballistic dissolution and radiation-enhanced diffusion which are key contributors to overall precipitate stability. This is the second paper in a series of three to provide a systematic evaluation of MX precipitate behavior in RAFM steels under various fusion-relevant ion irradiation conditions.
△ Less
Submitted 28 July, 2024;
originally announced July 2024.
-
MX precipitate behavior in an irradiated advanced Fe-9Cr steel: Self-ion irradiation effects on phase stability
Authors:
T. M. Kelsy Green,
Tim Graening,
Weicheng Zhong,
Ying Yang,
Kevin G. Field
Abstract:
Reduced activation ferritic/martensitic (RAFM) steels are the leading candidate structural materials for first-wall and blanket components in fusion reactors. This work is the first in a series to provide a systematic roadmap of MX precipitate stability in RAFM steels under various ion irradiation conditions. Here, the MX-TiC precipitate behavior in an advanced Fe-9Cr RAFM steel is assessed under…
▽ More
Reduced activation ferritic/martensitic (RAFM) steels are the leading candidate structural materials for first-wall and blanket components in fusion reactors. This work is the first in a series to provide a systematic roadmap of MX precipitate stability in RAFM steels under various ion irradiation conditions. Here, the MX-TiC precipitate behavior in an advanced Fe-9Cr RAFM steel is assessed under self-ion irradiation to damage levels ranging from 1 to 100 displacements per atom (dpa) at temperatures ranging from 300-600°C to isolate the effects of temperature and damage level on precipitate stability. The pre-existing MX-TiC precipitates are shown to exhibit temperature-dominated responses, including coarsening above 400°C at damage levels of 15 dpa, while damage levels studied at 50 dpa and higher showed dissolution across all temperature ranges studied. The effects of ballistic dissolution and diffusion on precipitate behavior are outlined as a function of precipitate characteristics (number density, size, and 25 volume fraction) and irradiation parameters with the use of the recoil resolution model of precipitate stability. This work provides critical insights into MX-TiC stability to high dose in-order to further optimize advanced steels with improved radiation resistance.
△ Less
Submitted 13 July, 2024;
originally announced July 2024.
-
Materials Swelling Revealed Through Automated Semantic Segmentation of Cavities in Electron Microscopy Images
Authors:
Ryan Jacobs,
Priyam Patki,
Matthew Lynch,
Steven Chen,
Dane Morgan,
Kevin G. Field
Abstract:
Accurately quantifying swelling of alloys that have undergone irradiation is essential for understanding alloy performance in a nuclear reactor and critical for the safe and reliable operation of reactor facilities. However, typical practice is for radiation-induced defects in electron microscopy images of alloys to be manually quantified by domain-expert researchers. Here, we employ an end-to-end…
▽ More
Accurately quantifying swelling of alloys that have undergone irradiation is essential for understanding alloy performance in a nuclear reactor and critical for the safe and reliable operation of reactor facilities. However, typical practice is for radiation-induced defects in electron microscopy images of alloys to be manually quantified by domain-expert researchers. Here, we employ an end-to-end deep learning approach using the Mask Regional Convolutional Neural Network (Mask R-CNN) model to detect and quantify nanoscale cavities in irradiated alloys. We have assembled the largest database of labeled cavity images to date, which includes 400 images, >34k discrete cavities, and numerous alloy compositions and irradiation conditions. We have evaluated both statistical (precision, recall, and F1 scores) and materials property-centric (cavity size, density, and swelling) metrics of model performance, and performed in-depth analysis of materials swelling assessments. We find our model gives assessments of material swelling with an average (standard deviation) swelling mean absolute error based on random leave-out cross-validation of 0.30 (0.03) percent swelling. This result demonstrates our approach can accurately provide swelling metrics on a per-image and per-condition basis, which can provide helpful insight into material design (e.g., alloy refinement) and impact of service conditions (e.g., temperature, irradiation dose) on swelling. Finally, we find there are cases of test images with poor statistical metrics, but small errors in swelling, pointing to the need for moving beyond traditional classification-based metrics to evaluate object detection models in the context of materials domain applications.
△ Less
Submitted 2 August, 2022;
originally announced August 2022.
-
Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs
Authors:
Ryan Jacobs,
Mingren Shen,
Yuhan Liu,
Wei Hao,
Xiaoshan Li,
Ruoyu He,
Jacob RC Greaves,
Donglin Wang,
Zeming Xie,
Zitong Huang,
Chao Wang,
Kevin G. Field,
Dane Morgan
Abstract:
In this work, we perform semantic segmentation of multiple defect types in electron microscopy images of irradiated FeCrAl alloys using a deep learning Mask Regional Convolutional Neural Network (Mask R-CNN) model. We conduct an in-depth analysis of key model performance statistics, with a focus on quantities such as predicted distributions of defect shapes, defect sizes, and defect areal densitie…
▽ More
In this work, we perform semantic segmentation of multiple defect types in electron microscopy images of irradiated FeCrAl alloys using a deep learning Mask Regional Convolutional Neural Network (Mask R-CNN) model. We conduct an in-depth analysis of key model performance statistics, with a focus on quantities such as predicted distributions of defect shapes, defect sizes, and defect areal densities relevant to informing modeling and understanding of irradiated Fe-based materials properties. To better understand the performance and present limitations of the model, we provide examples of useful evaluation tests which include a suite of random splits, and dataset size-dependent and domain-targeted cross validation tests. Overall, we find that the current model is a fast, effective tool for automatically characterizing and quantifying multiple defect types in microscopy images, with a level of accuracy on par with human domain expert labelers. More specifically, the model can achieve average defect identification F1 scores as high as 0.8, and, based on random cross validation, have low overall average (+/- standard deviation) defect size and density percentage errors of 7.3 (+/- 3.8)% and 12.7 (+/- 5.3)%, respectively. Further, our model predicts the expected material hardening to within 10-20 MPa (about 10% of total hardening), which is about the same error level as experiments. Our targeted evaluation tests also suggest the best path toward improving future models is not expanding existing databases with more labeled images but instead data additions that target weak points of the model domain, such as images from different microscopes, imaging conditions, irradiation environments, and alloy types. Finally, we discuss the first phase of an effort to provide an easy-to-use, open-source object detection tool to the broader community for identifying defects in new images.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
A Deep Learning Based Automatic Defect Analysis Framework for In-situ TEM Ion Irradiations
Authors:
Mingren Shen,
Guanzhao Li,
Dongxia Wu,
Yudai Yaguchi,
Jack C. Haley,
Kevin G. Field,
Dane Morgan
Abstract:
Videos captured using Transmission Electron Microscopy (TEM) can encode details regarding the morphological and temporal evolution of a material by taking snapshots of the microstructure sequentially. However, manual analysis of such video is tedious, error-prone, unreliable, and prohibitively time-consuming if one wishes to analyze a significant fraction of frames for even videos of modest length…
▽ More
Videos captured using Transmission Electron Microscopy (TEM) can encode details regarding the morphological and temporal evolution of a material by taking snapshots of the microstructure sequentially. However, manual analysis of such video is tedious, error-prone, unreliable, and prohibitively time-consuming if one wishes to analyze a significant fraction of frames for even videos of modest length. In this work, we developed an automated TEM video analysis system for microstructural features based on the advanced object detection model called YOLO and tested the system on an in-situ ion irradiation TEM video of dislocation loops formed in a FeCrAl alloy. The system provides analysis of features observed in TEM including both static and dynamic properties using the YOLO-based defect detection module coupled to a geometry analysis module and a dynamic tracking module. Results show that the system can achieve human comparable performance with an F1 score of 0.89 for fast, consistent, and scalable frame-level defect analysis. This result is obtained on a real but exceptionally clean and stable data set and more challenging data sets may not achieve this performance. The dynamic tracking also enabled evaluation of individual defect evolution like per defect growth rate at a fidelity never before achieved using common human analysis methods. Our work shows that automatically detecting and tracking interesting microstructures and properties contained in TEM videos is viable and opens new doors for evaluating materials dynamics.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
Direct Experimental Evidence for Differing Reactivity Alterations of Minerals following Irradiation: The Case of Calcite and Quartz
Authors:
Isabella Pignatelli,
Aditya Kumar,
Kevin G. Field,
Bu Wang,
Yingtian Yu,
Yann Le Pape,
Mathieu Bauchy,
Gaurav Sant
Abstract:
Concrete, a mixture formed by mixing cement, water, and fine and coarse mineral aggregates is used in the construction of nuclear power plants (NPPs), e.g., to construct the reactor cavity concrete that encases the reactor pressure vessel, etc. In such environments, concrete may be exposed to radiation (e.g., neutrons) emanating from the reactor core. Until recently, concrete has been assumed rela…
▽ More
Concrete, a mixture formed by mixing cement, water, and fine and coarse mineral aggregates is used in the construction of nuclear power plants (NPPs), e.g., to construct the reactor cavity concrete that encases the reactor pressure vessel, etc. In such environments, concrete may be exposed to radiation (e.g., neutrons) emanating from the reactor core. Until recently, concrete has been assumed relatively immune to radiation exposure. Direct evidence acquired on Ar$^+$-ion irradiated calcite and quartz indicates, on the contrary, that, such minerals, which constitute aggregates in concrete, may be significantly altered by irradiation. Specifically, while quartz undergoes disordering of its atomic structure resulting in a near complete lack of periodicity, i.e., similar to glassy silica, calcite only experiences random rotations, and distortions of its carbonate groups. As a result, irradiated quartz shows a reduction in density of around 15%, and an increase in chemical reactivity, described by its dissolution rate, similar to a glassy silica; i.e., an increase of around 3 orders of magnitude. Calcite however, shows little change in dissolution rates - although its density noted to reduce by around 9%. These differences are correlated with the nature of bonds in these minerals, i.e., being dominantly ionic or covalent, and the rigidity of the mineral's atomic network that is characterized by the number of topological constraints (n$_c$) that are imposed on the atoms in the network. The outcomes are discussed within the context of the durability of concrete structural elements formed with calcitic/quartzitic aggregates in nuclear power plants.
△ Less
Submitted 5 September, 2015;
originally announced September 2015.