-
Reinforcement Learning Optimizes Power Dispatch in Decentralized Power Grid
Authors:
Yongsun Lee,
Hoyun Choi,
Laurent Pagnier,
Cook Hyun Kim,
Jongshin Lee,
Bukyoung Jhun,
Heetae Kim,
Juergen Kurths,
B. Kahng
Abstract:
Effective frequency control in power grids has become increasingly important with the increasing demand for renewable energy sources. Here, we propose a novel strategy for resolving this challenge using graph convolutional proximal policy optimization (GC-PPO). The GC-PPO method can optimally determine how much power individual buses dispatch to reduce frequency fluctuations across a power grid. W…
▽ More
Effective frequency control in power grids has become increasingly important with the increasing demand for renewable energy sources. Here, we propose a novel strategy for resolving this challenge using graph convolutional proximal policy optimization (GC-PPO). The GC-PPO method can optimally determine how much power individual buses dispatch to reduce frequency fluctuations across a power grid. We demonstrate its efficacy in controlling disturbances by applying the GC-PPO to the power grid of the UK. The performance of GC-PPO is outstanding compared to the classical methods. This result highlights the promising role of GC-PPO in enhancing the stability and reliability of power systems by switching lines or decentralizing grid topology.
△ Less
Submitted 21 July, 2024;
originally announced July 2024.
-
Evolving Network Modeling Driven by the Degree Increase and Decrease Mechanism
Authors:
Yuhan Li,
Minyu Feng,
Jürgen Kurths
Abstract:
Ever since the Barabási-Albert (BA) scale-free network has been proposed, network modeling has been studied intensively in light of the network growth and the preferential attachment (PA). However, numerous real systems are featured with a dynamic evolution including network reduction in addition to network growth. In this paper, we propose a novel mechanism for evolving networks from the perspect…
▽ More
Ever since the Barabási-Albert (BA) scale-free network has been proposed, network modeling has been studied intensively in light of the network growth and the preferential attachment (PA). However, numerous real systems are featured with a dynamic evolution including network reduction in addition to network growth. In this paper, we propose a novel mechanism for evolving networks from the perspective of vertex degree. We construct a queueing system to describe the increase and decrease of vertex degree, which drives the network evolution. In our mechanism, the degree increase rate is regarded as a function positively correlated to the degree of a vertex, ensuring the preferential attachment in a new way. Degree distributions are investigated under two expressions of the degree increase rate, one of which manifests a ``long tail'', and another one varies with different values of parameters. In simulations, we compare our theoretical distributions with simulation results and also apply them to real networks, which presents the validity and applicability of our model.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Protection Degree and Migration in the Stochastic SIRS Model: A Queueing System Perspective
Authors:
Yuhan Li,
Ziyan Zeng,
Minyu Feng,
Jürgen Kurths
Abstract:
With the prevalence of COVID-19, the modeling of epidemic propagation and its analyses have played a significant role in controlling epidemics. However, individual behaviors, in particular the self-protection and migration, which have a strong influence on epidemic propagation, were always neglected in previous studies. In this paper, we mainly propose two models from the individual and population…
▽ More
With the prevalence of COVID-19, the modeling of epidemic propagation and its analyses have played a significant role in controlling epidemics. However, individual behaviors, in particular the self-protection and migration, which have a strong influence on epidemic propagation, were always neglected in previous studies. In this paper, we mainly propose two models from the individual and population perspectives. In the first individual model, we introduce the individual protection degree that effectively suppresses the epidemic level as a stochastic variable to the SIRS model. In the alternative population model, an open Markov queueing network is constructed to investigate the individual number of each epidemic state, and we present an evolving population network via the migration of people. Besides, stochastic methods are applied to analyze both models. In various simulations, the infected probability, the number of individuals in each state and its limited distribution are demonstrated.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Spatio-temporal Patterns between ENSO and Weather-related Power Outages in the Continental United States
Authors:
Long Huo,
Xin Chen,
Kaiwen Li,
Fengying Cai,
Jürgen Kurths
Abstract:
El Niño-Southern Oscillation (ENSO) exhibits significant impacts on the frequency of extreme weather events and its socio-economic implications prevail on a global scale. However, a fundamental gap still exists in understanding the relationship between the ENSO and weather-related power outages in the continental United States. Through 24-year (2000-2023) composite and statistical analysis, our st…
▽ More
El Niño-Southern Oscillation (ENSO) exhibits significant impacts on the frequency of extreme weather events and its socio-economic implications prevail on a global scale. However, a fundamental gap still exists in understanding the relationship between the ENSO and weather-related power outages in the continental United States. Through 24-year (2000-2023) composite and statistical analysis, our study reveals that higher power outage numbers (PONs) are observed from the developing winter to the decaying summer of La Niña phases. In particular, during the decaying spring, high La Niña intensity favors the occurrences of power outage over the west coast and east of the United States, by modulating the frequency of extreme precipitations and heatwaves. Furthermore, projected increasing heatwaves from the Coupled Model Intercomparison Project Phase 6 (CMIP6) indicate that spring-time PONs over the eastern United States occur about 11 times higher for the mid-term future (2041-2060) and almost 26 times higher for the long-term future (2081-2100), compared with 2000-2023. Our study provides a strong recommendation for building a more climate-resilient power system.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Probabilistic Behavioral Distance and Tuning - Reducing and aggregating complex systems
Authors:
Frank Hellmann,
Ekaterina Zolotarevskaia,
Jürgen Kurths,
Jörg Raisch
Abstract:
Given a complex system with a given interface to the rest of the world, what does it mean for a the system to behave close to a simpler specification describing the behavior at the interface? We give several definitions for useful notions of distances between a complex system and a specification by combining a behavioral and probabilistic perspective. These distances can be used to tune a complex…
▽ More
Given a complex system with a given interface to the rest of the world, what does it mean for a the system to behave close to a simpler specification describing the behavior at the interface? We give several definitions for useful notions of distances between a complex system and a specification by combining a behavioral and probabilistic perspective. These distances can be used to tune a complex system to a specification. We show that our approach can successfully tune non-linear networked systems to behave like much smaller networks, allowing us to aggregate large sub-networks into one or two effective nodes. Finally, we discuss similarities and differences between our approach and $H_\infty$ model reduction.
△ Less
Submitted 24 November, 2021;
originally announced November 2021.
-
Predicting Basin Stability of Power Grids using Graph Neural Networks
Authors:
Christian Nauck,
Michael Lindner,
Konstantin Schürholt,
Haoming Zhang,
Paul Schultz,
Jürgen Kurths,
Ingrid Isenhardt,
Frank Hellmann
Abstract:
The prediction of dynamical stability of power grids becomes more important and challenging with increasing shares of renewable energy sources due to their decentralized structure, reduced inertia and volatility. We investigate the feasibility of applying graph neural networks (GNN) to predict dynamic stability of synchronisation in complex power grids using the single-node basin stability (SNBS)…
▽ More
The prediction of dynamical stability of power grids becomes more important and challenging with increasing shares of renewable energy sources due to their decentralized structure, reduced inertia and volatility. We investigate the feasibility of applying graph neural networks (GNN) to predict dynamic stability of synchronisation in complex power grids using the single-node basin stability (SNBS) as a measure. To do so, we generate two synthetic datasets for grids with 20 and 100 nodes respectively and estimate SNBS using Monte-Carlo sampling. Those datasets are used to train and evaluate the performance of eight different GNN-models. All models use the full graph without simplifications as input and predict SNBS in a nodal-regression-setup. We show that SNBS can be predicted in general and the performance significantly changes using different GNN-models. Furthermore, we observe interesting transfer capabilities of our approach: GNN-models trained on smaller grids can directly be applied on larger grids without the need of retraining.
△ Less
Submitted 5 May, 2022; v1 submitted 18 August, 2021;
originally announced August 2021.
-
A multilayer, multi-timescale model approach for economic and frequency control in power grids
Authors:
Lia Strenge,
Paul Schultz,
Jürgen Kurths,
Jörg Raisch,
Frank Hellmann
Abstract:
Power systems are subject to fundamental changes due to the increasing infeed of decentralised renewable energy sources and storage. The decentralised nature of the new actors in the system requires new concepts for structuring the power grid, and achieving a wide range of control tasks ranging from seconds to days. Here we introduce a multiplex dynamical network model covering all control timesca…
▽ More
Power systems are subject to fundamental changes due to the increasing infeed of decentralised renewable energy sources and storage. The decentralised nature of the new actors in the system requires new concepts for structuring the power grid, and achieving a wide range of control tasks ranging from seconds to days. Here we introduce a multiplex dynamical network model covering all control timescales. Crucially, we combine a decentralised, self-organised low-level control and a smart grid layer of devices that can aggregate information from remote sources. The safety-critical task of frequency control is performed by the former, the economic objective of demand matching dispatch by the latter. Having both aspects present in the same model allows us to study the interaction between the layers. Remarkably, we find that adding communication in the form of aggregation does not improve the performance in the cases considered. Instead, the self-organised state of the system already contains the information required to learn the demand structure in the entire grid. The model introduced here is highly flexible, and can accommodate a wide range of scenarios relevant to future power grids. We expect that it is especially useful in the context of low-energy microgrids with distributed generation.
△ Less
Submitted 26 March, 2020;
originally announced March 2020.
-
Iterative learning control in prosumer-based microgrids with hierarchical control
Authors:
Lia Strenge,
Xiaohan Jing,
Ruth Boersma,
Paul Schultz,
Frank Hellmann,
Jürgen Kurths,
Jörg Raisch,
Thomas Seel
Abstract:
Power systems are subject to fundamental changes due to the increasing infeed of renewable energy sources. Taking the accompanying decentralization of power generation into account, the concept of prosumer-based microgrids gives the opportunity to rethink structuring and operation of power systems from scratch. In a prosumer-based microgrid, each power grid node can feed energy into the grid and d…
▽ More
Power systems are subject to fundamental changes due to the increasing infeed of renewable energy sources. Taking the accompanying decentralization of power generation into account, the concept of prosumer-based microgrids gives the opportunity to rethink structuring and operation of power systems from scratch. In a prosumer-based microgrid, each power grid node can feed energy into the grid and draw energy from the grid. The concept allows for spatial aggregation such that also an interaction between microgrids can be represented as a prosumer-based microgrid. The contribution of this work is threefold: (i) we propose a decentralized hierarchical control approach in a network including different time scales, (ii) we use iterative learning control to compensate periodic demand patterns and save lower layer control energy and (iii) we assure asymptotic stability and monotonic convergence in the iteration domain for the linearized dynamics and validate the performance by simulating the nonlinear dynamics.
△ Less
Submitted 26 June, 2020; v1 submitted 26 March, 2020;
originally announced March 2020.
-
Improving power grid transient stability by plug-in electric vehicles
Authors:
Andrej Gajduk,
Mirko Todorovski,
Juergen Kurths,
Ljupco Kocarev
Abstract:
Plug-in electric vehicles (PEVs) can serve in discharge mode as distributed energy and power resources operating as vehicle-to-grid (V2G) devices and in charge mode as loads or grid-to-vehicle (G2V) devices. It has been documented that PEVs serving as V2G systems can offer possible backup for renewable power sources, can provide reactive power support, active power regulation, load balancing, peak…
▽ More
Plug-in electric vehicles (PEVs) can serve in discharge mode as distributed energy and power resources operating as vehicle-to-grid (V2G) devices and in charge mode as loads or grid-to-vehicle (G2V) devices. It has been documented that PEVs serving as V2G systems can offer possible backup for renewable power sources, can provide reactive power support, active power regulation, load balancing, peak load shaving,% and current harmonic filtering, can provide ancillary services as frequency control and spinning reserves, can improve grid efficiency, stability, reliability, and generation dispatch, can reduce utility operating costs and can generate revenue. Here we show that PEVs can even improve power grid transient stability, that is, stability when the power grid is subjected to large disturbances, including bus faults, generator and branch tripping, and sudden large load changes. A control strategy that regulates the power output of a fleet of PEVs based on the speed of generator turbines is proposed and tested on the New England 10-unit 39-bus power system. By regulating the power output of the PEVs we show that (1) speed and voltage fluctuations resulting from large disturbances can be significantly reduced up to 5 times, and (2) the critical clearing time can be extended by 20-40%. Overall, the PEVs control strategy makes the power grid more robust.
△ Less
Submitted 7 October, 2014;
originally announced October 2014.
