-
Active Disruption Avoidance and Trajectory Design for Tokamak Ramp-downs with Neural Differential Equations and Reinforcement Learning
Authors:
Allen M. Wang,
Oswin So,
Charles Dawson,
Darren T. Garnier,
Cristina Rea,
Chuchu Fan
Abstract:
The tokamak offers a promising path to fusion energy, but plasma disruptions pose a major economic risk, motivating considerable advances in disruption avoidance. This work develops a reinforcement learning approach to this problem by training a policy to safely ramp-down the plasma current while avoiding limits on a number of quantities correlated with disruptions. The policy training environment…
▽ More
The tokamak offers a promising path to fusion energy, but plasma disruptions pose a major economic risk, motivating considerable advances in disruption avoidance. This work develops a reinforcement learning approach to this problem by training a policy to safely ramp-down the plasma current while avoiding limits on a number of quantities correlated with disruptions. The policy training environment is a hybrid physics and machine learning model trained on simulations of the SPARC primary reference discharge (PRD) ramp-down, an upcoming burning plasma scenario which we use as a testbed. To address physics uncertainty and model inaccuracies, the simulation environment is massively parallelized on GPU with randomized physics parameters during policy training. The trained policy is then successfully transferred to a higher fidelity simulator where it successfully ramps down the plasma while avoiding user-specified disruptive limits. We also address the crucial issue of safety criticality by demonstrating that a constraint-conditioned policy can be used as a trajectory design assistant to design a library of feed-forward trajectories to handle different physics conditions and user settings. As a library of trajectories is more interpretable and verifiable offline, we argue such an approach is a promising path for leveraging the capabilities of reinforcement learning in the safety-critical context of burning plasma tokamaks. Finally, we demonstrate how the training environment can be a useful platform for other feed-forward optimization approaches by using an evolutionary algorithm to perform optimization of feed-forward trajectories that are robust to physics uncertainty
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Hybridizing Physics and Neural ODEs for Predicting Plasma Inductance Dynamics in Tokamak Fusion Reactors
Authors:
Allen M. Wang,
Darren T. Garnier,
Cristina Rea
Abstract:
While fusion reactors known as tokamaks hold promise as a firm energy source, advances in plasma control, and handling of events where control of plasmas is lost, are needed for them to be economical. A significant bottleneck towards applying more advanced control algorithms is the need for better plasma simulation, where both physics-based and data-driven approaches currently fall short. The form…
▽ More
While fusion reactors known as tokamaks hold promise as a firm energy source, advances in plasma control, and handling of events where control of plasmas is lost, are needed for them to be economical. A significant bottleneck towards applying more advanced control algorithms is the need for better plasma simulation, where both physics-based and data-driven approaches currently fall short. The former is bottle-necked by both computational cost and the difficulty of modelling plasmas, and the latter is bottle-necked by the relative paucity of data. To address this issue, this work applies the neural ordinary differential equations (ODE) framework to the problem of predicting a subset of plasma dynamics, namely the coupled plasma current and internal inductance dynamics. As the neural ODE framework allows for the natural inclusion of physics-based inductive biases, we train both physics-based and neural network models on data from the Alcator C-Mod fusion reactor and find that a model that combines physics-based equations with a neural ODE performs better than both existing physics-motivated ODEs and a pure neural ODE model.
△ Less
Submitted 30 October, 2023;
originally announced October 2023.
-
Continuous quantum measurement in spin environments
Authors:
Dong Xie,
An Min Wang
Abstract:
We derive a formalism of stochastic master equations (SME) which describes the decoherence dynamics of a system in spin environments conditioned on the measurement record. Markovian and non-Markovian nature of environment can be revealed by a spectroscopy method based on weak quantum measurement (weak spectroscopy). On account of that correlated environments can lead to a nonlocal open system whic…
▽ More
We derive a formalism of stochastic master equations (SME) which describes the decoherence dynamics of a system in spin environments conditioned on the measurement record. Markovian and non-Markovian nature of environment can be revealed by a spectroscopy method based on weak quantum measurement (weak spectroscopy). On account of that correlated environments can lead to a nonlocal open system which exhibits strong non-Markovian effects although the local dynamics are Markovian, the spectroscopy method can be used to demonstrate that there is correlation between two environments.
△ Less
Submitted 31 August, 2014;
originally announced September 2014.
