-
Greybox Learning of Languages Recognizable by Event-Recording Automata
Authors:
Anirban Majumdar,
Sayan Mukherjee,
Jean-François Raskin
Abstract:
In this paper, we revisit the active learning of timed languages recognizable by event-recording automata. Our framework employs a method known as greybox learning, which enables the learning of event-recording automata with a minimal number of control states. This approach avoids learning the region automaton associated with the language, contrasting with existing methods. We have implemented our…
▽ More
In this paper, we revisit the active learning of timed languages recognizable by event-recording automata. Our framework employs a method known as greybox learning, which enables the learning of event-recording automata with a minimal number of control states. This approach avoids learning the region automaton associated with the language, contrasting with existing methods. We have implemented our greybox learning algorithm with various heuristics to maintain low computational complexity. The efficacy of our approach is demonstrated through several examples.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
Pessimism of the Will, Optimism of the Intellect: Fair Protocols with Malicious but Rational Agents
Authors:
Léonard Brice,
Jean-François Raskin,
Mathieu Sassolas,
Guillaume Scerri,
Marie van den Bogaard
Abstract:
Fairness is a desirable and crucial property of many protocols that handle, for instance, exchanges of message.
It states that if at least one agent engaging in the protocol is honest, then either the protocol will unfold correctly and fulfill its intended goal for all participants, or it will fail for everyone.
In this work, we present a game-based framework for the study of fairness protocol…
▽ More
Fairness is a desirable and crucial property of many protocols that handle, for instance, exchanges of message.
It states that if at least one agent engaging in the protocol is honest, then either the protocol will unfold correctly and fulfill its intended goal for all participants, or it will fail for everyone.
In this work, we present a game-based framework for the study of fairness protocols, that does not define a priori an attacker model.
It is based on the notion of strong secure equilibria, and leverages the conceptual and algorithmic toolbox of game theory.
In the case of finite games, we provide decision procedures with tight complexity bounds for determining whether a protocol is immune to nefarious attacks from a coalition of participants, and whether such a protocol could exist based on the underlying graph structure and objectives.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
AlN/Si interface engineering to mitigate RF losses in MOCVD grown GaN-on-Si substrates
Authors:
Pieter Cardinael,
Sachin Yadav,
Herwig Hahn,
Ming Zhao,
Sourish Banerjee,
Babak Kazemi Esfeh,
Christof Mauder,
Barry O Sullivan,
Uthayasankaran Peralagu,
Anurag Vohra,
Robert Langer,
Nadine Collaert,
Bertrand Parvais,
Jean-Pierre Raskin
Abstract:
Fabrication of low-RF loss GaN-on-Si HEMT stacks is critical to enable competitive front-end-modules for 5G and 6G applications. The main contribution to RF losses is the interface between the III-N layer and the HR Si wafer, more specifically the AlN/Si interface. At this interface, a parasitic surface conduction layer exists in Si, which decreases the substrate effective resistivity sensed by ov…
▽ More
Fabrication of low-RF loss GaN-on-Si HEMT stacks is critical to enable competitive front-end-modules for 5G and 6G applications. The main contribution to RF losses is the interface between the III-N layer and the HR Si wafer, more specifically the AlN/Si interface. At this interface, a parasitic surface conduction layer exists in Si, which decreases the substrate effective resistivity sensed by overlying circuitry below the nominal Si resistivity. However, a clear understanding of this interface with control of the parasitic channel is lacking. In this letter, a detailed physical and electrical description of MOCVD-grown AlN/Si structures is presented. The presence of a $\text{SiC}_\text{x}\text{N}_\text{y}$ interfacial layer is revealed and its importance for RF losses is shown. Through C-V and I-V characterisation, an increase in the C concentration of this interfacial layer is linked to the formation of negative charge at the AlN/Si interface, which counteracts the positive charge present in the 0-predose limit. The variation of TMAl predose is shown to allow precise tuning of the C composition and, consequently, the resulting interface charge. Notably, a linear relationship between predose and net interface charge is observed and confirmed by the fabrication of an AlN/Si sample with close to zero net charge. In addition, a higher $D_{it}$ ($\sim 2\times 10^{12}$ cm$^\text{-2}$) for such compensated samples is observed and can contribute to low RF loss. An exceptionally high effective resistivity of above 8 k$Ω\cdot$cm is achieved, corresponding to an RF loss below 0.3 dB/mm at 10 GHz.
△ Less
Submitted 13 August, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
-
As Soon as Possible but Rationally
Authors:
Véronique Bruyère,
Christophe Grandmont,
Jean-François Raskin
Abstract:
This paper addresses complexity problems in rational verification and synthesis for multi-player games played on weighted graphs, where the objective of each player is to minimize the cost of reaching a specific set of target vertices. In these games, one player, referred to as the system, declares his strategy upfront. The other players, composing the environment, then rationally make their moves…
▽ More
This paper addresses complexity problems in rational verification and synthesis for multi-player games played on weighted graphs, where the objective of each player is to minimize the cost of reaching a specific set of target vertices. In these games, one player, referred to as the system, declares his strategy upfront. The other players, composing the environment, then rationally make their moves according to their objectives. The rational behavior of these responding players is captured through two models: they opt for strategies that either represent a Nash equilibrium or lead to a play with a Pareto-optimal cost tuple.
△ Less
Submitted 2 July, 2024; v1 submitted 1 March, 2024;
originally announced March 2024.
-
The Paradox of Industrial Involvement in Engineering Higher Education
Authors:
Srinjoy Mitra,
Jean-Pierre Raskin
Abstract:
This paper discusses the importance of reflective and socially conscious education in engineering schools, particularly within the EE/CS sector. While most engineering disciplines have historically aligned themselves with the demands of the technology industry, the lack of critical examination of industry practices and their impact on justice, equality, and sustainability is self-evident. Today, t…
▽ More
This paper discusses the importance of reflective and socially conscious education in engineering schools, particularly within the EE/CS sector. While most engineering disciplines have historically aligned themselves with the demands of the technology industry, the lack of critical examination of industry practices and their impact on justice, equality, and sustainability is self-evident. Today, the for-profit engineering/technology companies, some of which are among the largest in the world, also shape the narrative of engineering education and research in universities. As engineering graduates form the largest cohorts within STEM disciplines in Western countries, they become future professionals who will work, lead, or even establish companies in this industry. Unfortunately, the curriculum within engineering education often lacks a deep understanding of social realities, an essential component of a comprehensive university education. Here we establish this unusual connection with the industry that has driven engineering higher education for several decades and its obvious negative impacts to society. We analyse this nexus and highlight the need for engineering schools to hold a more critical viewpoint. Given the wealth and power of modern technology companies, particularly in the ICT domain, questioning their techno-solutionism narrative is essential within the institutes of higher education.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Role of ICT Innovation in Perpetuating the Myth of Techno-Solutionism
Authors:
Srinjoy Mitra,
Jean-Pierre Raskin,
Mario Pansera
Abstract:
Innovation in Information and Communication Technology has become one of the key economic drivers of our technology dependent world. In popular notion, the tech industry or how ICT is often known has become synonymous to all technologies that drive modernity. Digital technologies have become so pervasive that it is hard to imagine new technology developments that are not totally or partially influ…
▽ More
Innovation in Information and Communication Technology has become one of the key economic drivers of our technology dependent world. In popular notion, the tech industry or how ICT is often known has become synonymous to all technologies that drive modernity. Digital technologies have become so pervasive that it is hard to imagine new technology developments that are not totally or partially influenced by ICT innovations. Furthermore, the pace of innovation in ICT sector over the last few decades has been unprecedented in human history. In this paper we argue that, not only ICT had a tremendous impact on the way we communicate and produce but this innovation paradigm has crucially shaped collective expectations and imagination about what technology more broadly can actually deliver. These expectations have often crystalised into a widespread acceptance, among general public and policy makers, of technosolutionism. This is a belief that technology not restricted to ICT alone can solve all problems humanity is facing from poverty and inequality to ecosystem loss and climate change. In this paper we show the many impacts of relentless ICT innovation. The spectacular advances in this sector, coupled with corporate power that benefits from them have facilitated the uptake by governments and industries of an uncritical narrative of techno-optimist that neglects the complexity of the wicked problems that affect the present and future of humanity.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Band gap reduction in highly-strained silicon beams predicted by first-principles theory and validated using photoluminescence spectroscopy
Authors:
Nicolas Roisin,
Marie-Stéphane Colla,
Romain Scaffidi,
Thomas Pardoen,
Denis Flandre,
Jean-Pierre Raskin
Abstract:
A theoretical study of the band gap reduction under tensile stress is performed and validated through experimental measurements. First-principles calculations based on density functional theory (DFT) are performed for uniaxial stress applied in the [001], [110] and [111] directions. The calculated band gap reductions are equal to 126, 240 and 100 meV at 2$\%$ strain, respectively. Photoluminescenc…
▽ More
A theoretical study of the band gap reduction under tensile stress is performed and validated through experimental measurements. First-principles calculations based on density functional theory (DFT) are performed for uniaxial stress applied in the [001], [110] and [111] directions. The calculated band gap reductions are equal to 126, 240 and 100 meV at 2$\%$ strain, respectively. Photoluminescence spectroscopy experiments are performed by deformation applied in the [110] direction. Microfabricated specimens have been deformed using an on-chip tensile technique up to ~1$\%$ as confirmed by back-scattering Raman spectroscopy. A fitting correction based on the band gap fluctuation model has been used to eliminate the specimen interference signal and retrieve reliable values. Very good agreement is observed between first-principles theory and experimental results with a band gap reduction of, respectively, 93 and 91 meV when the silicon beam is deformed by 0.95$\%$ along the [110] direction.
△ Less
Submitted 21 August, 2023;
originally announced August 2023.
-
Formally-Sharp DAgger for MCTS: Lower-Latency Monte Carlo Tree Search using Data Aggregation with Formal Methods
Authors:
Debraj Chakraborty,
Damien Busatto-Gaston,
Jean-François Raskin,
Guillermo A. Pérez
Abstract:
We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking techniques to guide the MCTS algorithm in order to generate offline samples of high-quality decisions on a representative set of states of the MDP. Those sampl…
▽ More
We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking techniques to guide the MCTS algorithm in order to generate offline samples of high-quality decisions on a representative set of states of the MDP. Those samples can then be used to train a neural network that imitates the policy used to generate them. This neural network can either be used as a guide on a lower-latency MCTS online search, or alternatively be used as a full-fledged policy when minimal latency is required. We use statistical model checking to detect when additional samples are needed and to focus those additional samples on configurations where the learnt neural network policy differs from the (computationally-expensive) offline policy. We illustrate the use of our method on MDPs that model the Frozen Lake and Pac-Man environments -- two popular benchmarks to evaluate reinforcement-learning algorithms.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
Bi-Objective Lexicographic Optimization in Markov Decision Processes with Related Objectives
Authors:
Damien Busatto-Gaston,
Debraj Chakraborty,
Anirban Majumdar,
Sayan Mukherjee,
Guillermo A. Pérez,
Jean-François Raskin
Abstract:
We consider lexicographic bi-objective problems on Markov Decision Processes (MDPs), where we optimize one objective while guaranteeing optimality of another. We propose a two-stage technique for solving such problems when the objectives are related (in a way that we formalize). We instantiate our technique for two natural pairs of objectives: minimizing the (conditional) expected number of steps…
▽ More
We consider lexicographic bi-objective problems on Markov Decision Processes (MDPs), where we optimize one objective while guaranteeing optimality of another. We propose a two-stage technique for solving such problems when the objectives are related (in a way that we formalize). We instantiate our technique for two natural pairs of objectives: minimizing the (conditional) expected number of steps to a target while guaranteeing the optimal probability of reaching it; and maximizing the (conditional) expected average reward while guaranteeing an optimal probability of staying safe (w.r.t. some safe set of states). For the first combination of objectives, which covers the classical frozen lake environment from reinforcement learning, we also report on experiments performed using a prototype implementation of our algorithm and compare it with what can be obtained from state-of-the-art probabilistic model checkers solving optimal reachability.
△ Less
Submitted 15 August, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
-
Rational verification and checking for Nash and subgame-perfect equilibria in graph games
Authors:
Léonard Brice,
Jean-François Raskin,
Marie van den Bogaard
Abstract:
We study two natural problems about rational behaviors in multiplayer non-zero-sum sequential infinite duration games played on graphs: checking problems, that consist in deciding whether a strategy profile, defined by a Mealy machine, is rational; and rational verification, that consists in deciding whether all the rational answers to a given strategy satisfy some specification. We give the compl…
▽ More
We study two natural problems about rational behaviors in multiplayer non-zero-sum sequential infinite duration games played on graphs: checking problems, that consist in deciding whether a strategy profile, defined by a Mealy machine, is rational; and rational verification, that consists in deciding whether all the rational answers to a given strategy satisfy some specification. We give the complexities of those problems for two major concepts of rationality: Nash equilibria and subgame-perfect equilibria, and for five major classes of payoff functions: parity, mean-payoff, quantitative reachability, energy, and discounted-sum.
△ Less
Submitted 14 July, 2023; v1 submitted 30 January, 2023;
originally announced January 2023.
-
LTL Reactive Synthesis with a Few Hints
Authors:
Mrudula Balachander,
Emmanuel Filiot,
Jean-François Raskin
Abstract:
We study a variant of the problem of synthesizing Mealy machines that enforce LTL specifications against all possible behaviours of the environment including hostile ones. In the variant studied here, the user provides the high level LTL specification φ of the system to design, and a set E of examples of executions that the solution must produce. Our synthesis algorithm works in two phases. First,…
▽ More
We study a variant of the problem of synthesizing Mealy machines that enforce LTL specifications against all possible behaviours of the environment including hostile ones. In the variant studied here, the user provides the high level LTL specification φ of the system to design, and a set E of examples of executions that the solution must produce. Our synthesis algorithm works in two phases. First, it generalizes the decisions taken along the examples E using tailored extensions of automata learning algorithms. This phase generalizes the user-provided examples in E while preserving realizability of φ. Second, the algorithm turns the (usually) incomplete Mealy machine obtained by the learning phase into a complete Mealy machine that realizes φ. The examples are used to guide the synthesis procedure. We provide a completeness result that shows that our procedure can learn any Mealy machine M that realizes φ with a small (polynomial) set of examples. We also show that our problem, that generalizes the classical LTL synthesis problem (i.e. when E = {\emptyset}), matches its worst-case complexity. The additional cost of learning from E is even polynomial in the size of E and in the size of a symbolic representation of solutions that realize φ. This symbolic representation is computed by the synthesis algorithm implemented in Acacia-Bonzai when solving the plain LTL synthesis problem. We illustrate the practical interest of our approach on a set of examples.
△ Less
Submitted 25 January, 2023;
originally announced January 2023.
-
Raman Strain-Shift Measurements and Prediction from First-Principles in Highly-Strained Silicon
Authors:
Nicolas Roisin,
Marie-Stéphane Colla,
Jean-Pierre Raskin,
Denis Flandre
Abstract:
This work presents how first-principles simulations validated through experimental measurements lead to a new accurate prediction of the expected Raman shift as a function of strain in silicon. Structural relaxation of a strained primitive cell is first performed to tackle the relative displacement of the silicon atoms for each strain level. Density Functional Perturbation Theory (DFPT) is then us…
▽ More
This work presents how first-principles simulations validated through experimental measurements lead to a new accurate prediction of the expected Raman shift as a function of strain in silicon. Structural relaxation of a strained primitive cell is first performed to tackle the relative displacement of the silicon atoms for each strain level. Density Functional Perturbation Theory (DFPT) is then used to compute the energy of the optical phonon modes in highly-strained silicon and retrieve the strain-shift trend. The simulations are validated by experimental characterization, using scanning electron microscopy (SEM) coupled with backscattering Raman spectroscopy, of silicon microbeams fabricated using a top-down approach. The beams are strained up to 2$\%$ thanks to the internal tensile stress of silicon nitride actuators, allowing a validation of the perturbation theory in high-strain conditions. The results are compared with the phonon deformation potentials (PDP) theory and the uncertainty caused by the various parameters found in the literature is discussed. The simulated strain-shift coefficients of -175.77 cm$^{-1}$ (resp. -400.85 cm$^{-1}$) and the experimental one of -160.99 cm$^{-1}$ (resp. -414.97 cm$^{-1}$) are found for the longitudinal optical LO (resp. transverse optical TO$_1$) mode, showing good agreement.
△ Less
Submitted 30 January, 2023; v1 submitted 6 December, 2022;
originally announced December 2022.
-
Learning Probabilistic Temporal Safety Properties from Examples in Relational Domains
Authors:
Gavin Rens,
Wen-Chi Yang,
Jean-François Raskin,
Luc De Raedt
Abstract:
We propose a framework for learning a fragment of probabilistic computation tree logic (pCTL) formulae from a set of states that are labeled as safe or unsafe. We work in a relational setting and combine ideas from relational Markov Decision Processes with pCTL model-checking. More specifically, we assume that there is an unknown relational pCTL target formula that is satisfied by only safe states…
▽ More
We propose a framework for learning a fragment of probabilistic computation tree logic (pCTL) formulae from a set of states that are labeled as safe or unsafe. We work in a relational setting and combine ideas from relational Markov Decision Processes with pCTL model-checking. More specifically, we assume that there is an unknown relational pCTL target formula that is satisfied by only safe states, and has a horizon of maximum $k$ steps and a threshold probability $α$. The task then consists of learning this unknown formula from states that are labeled as safe or unsafe by a domain expert. We apply principles of relational learning to induce a pCTL formula that is satisfied by all safe states and none of the unsafe ones. This formula can then be used as a safety specification for this domain, so that the system can avoid getting into dangerous situations in future. Following relational learning principles, we introduce a candidate formula generation process, as well as a method for deciding which candidate formula is a satisfactory specification for the given labeled states. The cases where the expert knows and does not know the system policy are treated, however, much of the learning process is the same for both cases. We evaluate our approach on a synthetic relational domain.
△ Less
Submitted 7 November, 2022;
originally announced November 2022.
-
Strategy Synthesis for Global Window PCTL
Authors:
Benjamin Bordais,
Damien Busatto-Gaston,
Shibashis Guha,
Jean-François Raskin
Abstract:
Given a Markov decision process (MDP) $M$ and a formula $Φ$, the strategy synthesis problem asks if there exists a strategy $σ$ s.t. the resulting Markov chain $M[σ]$ satisfies $Φ$. This problem is known to be undecidable for the probabilistic temporal logic PCTL. We study a class of formulae that can be seen as a fragment of PCTL where a local, bounded horizon property is enforced all along an ex…
▽ More
Given a Markov decision process (MDP) $M$ and a formula $Φ$, the strategy synthesis problem asks if there exists a strategy $σ$ s.t. the resulting Markov chain $M[σ]$ satisfies $Φ$. This problem is known to be undecidable for the probabilistic temporal logic PCTL. We study a class of formulae that can be seen as a fragment of PCTL where a local, bounded horizon property is enforced all along an execution. Moreover, we allow for linear expressions in the probabilistic inequalities. This logic is at the frontier of decidability, depending on the type of strategies considered. In particular, strategy synthesis is decidable when strategies are deterministic while the general problem is undecidable.
△ Less
Submitted 25 April, 2022;
originally announced April 2022.
-
Subgame-perfect Equilibria in Mean-payoff Games (journal version)
Authors:
Léonard Brice,
Marie van den Bogaard,
Jean-François Raskin
Abstract:
In this paper, we provide an effective characterization of all the subgame-perfect equilibria in infinite duration games played on finite graphs with mean-payoff objectives. To this end, we introduce the notion of requirement, and the notion of negotiation function. We establish that the plays that are supported by SPEs are exactly those that are consistent with a fixed point of the negotiation fu…
▽ More
In this paper, we provide an effective characterization of all the subgame-perfect equilibria in infinite duration games played on finite graphs with mean-payoff objectives. To this end, we introduce the notion of requirement, and the notion of negotiation function. We establish that the plays that are supported by SPEs are exactly those that are consistent with a fixed point of the negotiation function. Finally, we use that characterization to prove that the SPE threshold problem, who status was left open in the literature, is decidable.
△ Less
Submitted 24 October, 2023; v1 submitted 16 March, 2022;
originally announced March 2022.
-
Stackelberg-Pareto Synthesis (Extended Version)
Authors:
Véronique Bruyère,
Baptiste Fievet,
Jean-François Raskin,
Clément Tamines
Abstract:
We study the framework of two-player Stackelberg games played on graphs in which Player 0 announces a strategy and Player 1 responds rationally with a strategy that is an optimal response. While it is usually assumed that Player 1 has a single objective, we consider here the new setting where he has several. In this context, after responding with his strategy, Player 1 gets a payoff in the form of…
▽ More
We study the framework of two-player Stackelberg games played on graphs in which Player 0 announces a strategy and Player 1 responds rationally with a strategy that is an optimal response. While it is usually assumed that Player 1 has a single objective, we consider here the new setting where he has several. In this context, after responding with his strategy, Player 1 gets a payoff in the form of a vector of Booleans corresponding to his satisfied objectives. Rationality of Player 1 is encoded by the fact that his response must produce a Pareto-optimal payoff given the strategy of Player 0. We study for several kinds of $ω$-regular objectives the Stackelberg-Pareto Synthesis problem which asks whether Player 0 can announce a strategy which satisfies his objective, whatever the rational response of Player 1. We show that this problem is fixed-parameter tractable for games in which objectives are all reachability, safety, Büchi, co-Büchi, Boolean Büchi, parity, Muller, Streett or Rabin objectives. We also show that this problem is NEXPTIME-complete except for the cases of Büchi objectives for which it is NP-complete and co-Büchi objectives for which it is in NEXPTIME and NP-hard. The problem is already NP-complete in the simple case of reachability objectives and graphs that are trees.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Pareto-Rational Verification
Authors:
Véronique Bruyère,
Jean-François Raskin,
Clément Tamines
Abstract:
We study the rational verification problem which consists in verifying the correctness of a system executing in an environment that is assumed to behave rationally. We consider the model of rationality in which the environment only executes behaviors that are Pareto-optimal with regard to its set of objectives, given the behavior of the system (which is committed in advance of any interaction). We…
▽ More
We study the rational verification problem which consists in verifying the correctness of a system executing in an environment that is assumed to behave rationally. We consider the model of rationality in which the environment only executes behaviors that are Pareto-optimal with regard to its set of objectives, given the behavior of the system (which is committed in advance of any interaction). We examine two ways of specifying this behavior, first by means of a deterministic Moore machine, and then by lifting its determinism. In the latter case the machine may embed several different behaviors for the system, and the universal rational verification problem aims at verifying that all of them are correct when the environment is rational. For parity objectives, we prove that the Pareto-rational verification problem is co-NP-complete and that its universal version is in PSPACE and both NP-hard and co-NP-hard. For Boolean Büchi objectives, the former problem is $Π_2\mathsf{P}$-complete and the latter is PSPACE-complete. We also study the case where the objectives are expressed using LTL formulas and show that the first problem is PSPACE-complete, and that the second is 2EXPTIME-complete. Both problems are also shown to be fixed-parameter tractable (FPT) for parity and Boolean Büchi objectives. Finally, we evaluate two variations of the FPT algorithm proposed to solve the Pareto-rational verification problem on a parametric toy example as well as on randomly generated instances.
△ Less
Submitted 9 July, 2022; v1 submitted 27 February, 2022;
originally announced February 2022.
-
The Complexity of SPEs in Mean-payoff Games
Authors:
Léonard Brice,
Jean-François Raskin,
Marie van den Bogaard
Abstract:
We establish that the subgame perfect equilibrium (SPE) threshold problem for mean-payoff games is NP-complete. While the SPE threshold problem was recently shown to be decidable (in doubly exponential time) and NP-hard, its exact worst case complexity was left open.
We establish that the subgame perfect equilibrium (SPE) threshold problem for mean-payoff games is NP-complete. While the SPE threshold problem was recently shown to be decidable (in doubly exponential time) and NP-hard, its exact worst case complexity was left open.
△ Less
Submitted 25 April, 2022; v1 submitted 17 February, 2022;
originally announced February 2022.
-
Low-Power Silicon Strain Sensor Based on CMOS Current Reference Topology
Authors:
Nicolas Roisin,
Thibault Delhaye,
Nicolas André,
Jean-Pierre Raskin,
Denis Flandre
Abstract:
A strain sensor inspired by a Widlar self-biased current source topology called $β$-multiplier is developed to obtain a strain-dependent reference current with high supply rejection. The sensor relies on the piezoresistive effect in the silicon MOS transistors that form the current reference circuit. The device behavior is analytically computed and verified with experimental measurements under fou…
▽ More
A strain sensor inspired by a Widlar self-biased current source topology called $β$-multiplier is developed to obtain a strain-dependent reference current with high supply rejection. The sensor relies on the piezoresistive effect in the silicon MOS transistors that form the current reference circuit. The device behavior is analytically computed and verified with experimental measurements under four-point bending test. A basic implementation with an integrated resistor reaches a strain sensitivity of 2.54 nA/$με$ (gauge factor of 324) for a temperature sensitivity of 52.06 nA/°C. A more advanced full-transistor circuit based on current subtraction principle is furthered implemented in order to reach strain sensitivity up to 12.02 nA/$με$ (gauge factor of 1773) and temperature sensitivity of -28.72 nA/°C. This implementation includes a CMOS active load to tune the strain and temperature sensitivities with a total power consumption between 20 and 150 $μ$W.
△ Less
Submitted 9 June, 2022; v1 submitted 31 January, 2022;
originally announced January 2022.
-
Indirect light absorption model for highly strained silicon infrared sensors
Authors:
Nicolas Roisin,
Guillaume Brunin,
Gian-Marco Rignanese,
Denis Flandre,
Jean-Pierre Raskin
Abstract:
The optical properties of silicon can be greatly tuned by applying strain and opening new perspectives, particularly in applications where infrared is key. In this work, we use a recent model for the indirect light absorption of silicon and include the effects of tensile and compressive uniaxial strains. The model is based on material properties such as the bandgap, the conduction and valence band…
▽ More
The optical properties of silicon can be greatly tuned by applying strain and opening new perspectives, particularly in applications where infrared is key. In this work, we use a recent model for the indirect light absorption of silicon and include the effects of tensile and compressive uniaxial strains. The model is based on material properties such as the bandgap, the conduction and valence band density-of-states effective masses, and the phonon frequencies, which are obtained from first principles including strain up to +2% along the [110] and [111] directions. We show that the limit of absorption can increase from 1.14 (1.09) to 1.35 $μ$m (0.92 eV) under 2% strain and that the absorption increases by a factor of 55 for the zero-strain cutoff wavelength of 1.14 $μ$m when a 2% compressive strain is applied in the [110] direction. We demonstrate that this effect is mainly due to the impact of strain on the electronic bandgaps of silicon, directly followed by the valence band density-of-states effective mass.
△ Less
Submitted 2 November, 2021; v1 submitted 17 August, 2021;
originally announced August 2021.
-
On the Complexity of SPEs in Parity Games
Authors:
Léonard Brice,
Marie van den Bogaard,
Jean-François Raskin
Abstract:
We study the complexity of problems related to subgame-perfect equilibria (SPEs) in infinite duration non zero-sum multiplayer games played on finite graphs with parity objectives. We present new complexity results that close gaps in the literature. Our techniques are based on a recent characterization of SPEs in prefix-independent games that is grounded on the notions of requirements and negotiat…
▽ More
We study the complexity of problems related to subgame-perfect equilibria (SPEs) in infinite duration non zero-sum multiplayer games played on finite graphs with parity objectives. We present new complexity results that close gaps in the literature. Our techniques are based on a recent characterization of SPEs in prefix-independent games that is grounded on the notions of requirements and negotiation, and according to which the plays supported by SPEs are exactly the plays consistent with the requirement that is the least fixed point of the negotiation function. The new results are as follows. First, checking that a given requirement is a fixed point of the negotiation function is an NP-complete problem. Second, we show that the SPE constrained existence problem is NP-complete, this problem was previously known to be ExpTime-easy and NP-hard. Third, the SPE constrained existence problem is fixed-parameter tractable when the number of players and of colors are parameters. Fourth, deciding whether some requirement is the least fixed point of the negotiation function is complete for the second level of the Boolean hierarchy. Finally, the SPE-verification problem -- that is, the problem of deciding whether there exists a play supported by a SPE that satisfies some LTL formula -- is PSpace-complete, this problem was known to be ExpTime-easy and PSpace-hard.
△ Less
Submitted 21 April, 2022; v1 submitted 15 July, 2021;
originally announced July 2021.
-
Lifted Model Checking for Relational MDPs
Authors:
Wen-Chi Yang,
Jean-François Raskin,
Luc De Raedt
Abstract:
Probabilistic model checking has been developed for verifying systems that have stochastic and nondeterministic behavior. Given a probabilistic system, a probabilistic model checker takes a property and checks whether or not the property holds in that system. For this reason, probabilistic model checking provide rigorous guarantees. So far, however, probabilistic model checking has focused on prop…
▽ More
Probabilistic model checking has been developed for verifying systems that have stochastic and nondeterministic behavior. Given a probabilistic system, a probabilistic model checker takes a property and checks whether or not the property holds in that system. For this reason, probabilistic model checking provide rigorous guarantees. So far, however, probabilistic model checking has focused on propositional models where a state is represented by a symbol. On the other hand, it is commonly required to make relational abstractions in planning and reinforcement learning. Various frameworks handle relational domains, for instance, STRIPS planning and relational Markov Decision Processes. Using propositional model checking in relational settings requires one to ground the model, which leads to the well known state explosion problem and intractability. We present pCTL-REBEL, a lifted model checking approach for verifying pCTL properties of relational MDPs. It extends REBEL, a relational model-based reinforcement learning technique, toward relational pCTL model checking. PCTL-REBEL is lifted, which means that rather than grounding, the model exploits symmetries to reason about a group of objects as a whole at the relational level. Theoretically, we show that pCTL model checking is decidable for relational MDPs that have a possibly infinite domain, provided that the states have a bounded size. Practically, we contribute algorithms and an implementation of lifted relational model checking, and we show that the lifted approach improves the scalability of the model checking approach.
△ Less
Submitted 10 January, 2022; v1 submitted 22 June, 2021;
originally announced June 2021.
-
Active Learning of Sequential Transducers with Side Information about the Domain
Authors:
Raphaël Berthon,
Adrien Boiret,
Guillermo A. Perez,
Jean-François Raskin
Abstract:
Active learning is a setting in which a student queries a teacher, through membership and equivalence queries, in order to learn a language. Performance on these algorithms is often measured in the number of queries required to learn a target, with an emphasis on costly equivalence queries. In graybox learning, the learning process is accelerated by foreknowledge of some information on the target.…
▽ More
Active learning is a setting in which a student queries a teacher, through membership and equivalence queries, in order to learn a language. Performance on these algorithms is often measured in the number of queries required to learn a target, with an emphasis on costly equivalence queries. In graybox learning, the learning process is accelerated by foreknowledge of some information on the target. Here, we consider graybox active learning of subsequential string transducers, where a regular overapproximation of the domain is known by the student. We show that there exists an algorithm using string equation solvers that uses this knowledge to learn subsequential string transducers with a better guarantee on the required number of equivalence queries than classical active learning.
△ Less
Submitted 23 April, 2021;
originally announced April 2021.
-
Stackelberg-Pareto Synthesis (Full Version)
Authors:
Véronique Bruyère,
Jean-François Raskin,
Clément Tamines
Abstract:
In this paper, we study the framework of two-player Stackelberg games played on graphs in which Player 0 announces a strategy and Player 1 responds rationally with a strategy that is an optimal response. While it is usually assumed that Player 1 has a single objective, we consider here the new setting where he has several. In this context, after responding with his strategy, Player 1 gets a payoff…
▽ More
In this paper, we study the framework of two-player Stackelberg games played on graphs in which Player 0 announces a strategy and Player 1 responds rationally with a strategy that is an optimal response. While it is usually assumed that Player 1 has a single objective, we consider here the new setting where he has several. In this context, after responding with his strategy, Player 1 gets a payoff in the form of a vector of Booleans corresponding to his satisfied objectives. Rationality of Player 1 is encoded by the fact that his response must produce a Pareto-optimal payoff given the strategy of Player 0. We study the Stackelberg-Pareto Synthesis problem which asks whether Player 0 can announce a strategy which satisfies his objective, whatever the rational response of Player 1. For games in which objectives are either all parity or all reachability objectives, we show that this problem is fixed-parameter tractable and NEXPTIME-complete. This problem is already NP-complete in the simple case of reachability objectives and graphs that are trees.
△ Less
Submitted 4 May, 2021; v1 submitted 17 February, 2021;
originally announced February 2021.
-
Subgame-perfect Equilibria in Mean-payoff Games
Authors:
Léonard Brice,
Jean-François Raskin,
Marie Van Den Bogaard
Abstract:
In this paper, we provide an effective characterization of all the subgame-perfect equilibria in infinite duration games played on finite graphs with mean-payoff objectives. To this end, we introduce the notion of requirement, and the notion of negotiation function. We establish that the plays that are supported by SPEs are exactly those that are consistent with the least fixed point of the negoti…
▽ More
In this paper, we provide an effective characterization of all the subgame-perfect equilibria in infinite duration games played on finite graphs with mean-payoff objectives. To this end, we introduce the notion of requirement, and the notion of negotiation function. We establish that the plays that are supported by SPEs are exactly those that are consistent with the least fixed point of the negotiation function. Finally, we show that the negotiation function is piecewise linear, and can be analyzed using the linear algebraic tool box. As a corollary, we prove the decidability of the SPE constrained existence problem, whose status was left open in the literature.
△ Less
Submitted 21 April, 2022; v1 submitted 26 January, 2021;
originally announced January 2021.
-
Online Learning of Non-Markovian Reward Models
Authors:
Gavin Rens,
Jean-François Raskin,
Raphaël Reynouad,
Giuseppe Marra
Abstract:
There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks, that is, rewards are non-Markovian. One natural and quite general way to represent history-dependent rewards is via a Mealy machine, a finite state automaton that produces output sequences from input sequences. In our formal setting, we consider a Markov decision process (MDP) t…
▽ More
There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks, that is, rewards are non-Markovian. One natural and quite general way to represent history-dependent rewards is via a Mealy machine, a finite state automaton that produces output sequences from input sequences. In our formal setting, we consider a Markov decision process (MDP) that models the dynamics of the environment in which the agent evolves and a Mealy machine synchronized with this MDP to formalize the non-Markovian reward function. While the MDP is known by the agent, the reward function is unknown to the agent and must be learned.
Our approach to overcome this challenge is to use Angluin's $L^*$ active learning algorithm to learn a Mealy machine representing the underlying non-Markovian reward machine (MRM). Formal methods are used to determine the optimal strategy for answering so-called membership queries posed by $L^*$.
Moreover, we prove that the expected reward achieved will eventually be at least as much as a given, reasonable value provided by a domain expert. We evaluate our framework on three problems. The results show that using $L^*$ to learn an MRM in a non-Markovian reward decision process is effective.
△ Less
Submitted 30 September, 2020; v1 submitted 26 September, 2020;
originally announced September 2020.
-
Proceedings 11th International Symposium on Games, Automata, Logics, and Formal Verification
Authors:
Jean-Francois Raskin,
Davide Bresolin
Abstract:
This volume contains the proceedings of the 11th International Symposium on Games, Automata, Logic and Formal Verification (GandALF 2020). The symposium took place as a fully online event on September 21-22, 2020. The GandALF symposium was established by a group of Italian computer scientists interested in mathematical logic, automata theory, game theory, and their applications to the specificatio…
▽ More
This volume contains the proceedings of the 11th International Symposium on Games, Automata, Logic and Formal Verification (GandALF 2020). The symposium took place as a fully online event on September 21-22, 2020. The GandALF symposium was established by a group of Italian computer scientists interested in mathematical logic, automata theory, game theory, and their applications to the specification, design, and verification of complex systems. Its aim is to provide a forum where people from different areas, and possibly with different backgrounds, can fruitfully interact. GandALF has a truly international spirit, as witnessed by the composition of the program and steering committee and by the country distribution of the submitted papers.
△ Less
Submitted 20 September, 2020;
originally announced September 2020.
-
Fragility and Robustness in Mean-Payoff Adversarial Stackelberg Games
Authors:
Mrudula Balachander,
Shibashis Guha,
Jean-François Raskin
Abstract:
Two-player mean-payoff Stackelberg games are nonzero-sum infinite duration games played on a bi-weighted graph by Leader (Player 0) and Follower (Player 1). Such games are played sequentially: first, Leader announces her strategy, second, Follower chooses his best-response. If we cannot impose which best-response is chosen by Follower, we say that Follower, though strategic, is adversarial towards…
▽ More
Two-player mean-payoff Stackelberg games are nonzero-sum infinite duration games played on a bi-weighted graph by Leader (Player 0) and Follower (Player 1). Such games are played sequentially: first, Leader announces her strategy, second, Follower chooses his best-response. If we cannot impose which best-response is chosen by Follower, we say that Follower, though strategic, is adversarial towards Leader. The maximal value that Leader can get in this nonzero-sum game is called the adversarial Stackelberg value (ASV) of the game.
We study the robustness of strategies for Leader in these games against two types of deviations: (i) Modeling imprecision - the weights on the edges of the game arena may not be exactly correct, they may be delta-away from the right one. (ii) Sub-optimal response - Follower may play epsilon-optimal best-responses instead of perfect best-responses. First, we show that if the game is zero-sum then robustness is guaranteed while in the nonzero-sum case, optimal strategies for ASV are fragile. Second, we provide a solution concept to obtain strategies for Leader that are robust to both modeling imprecision, and as well as to the epsilon-optimal responses of Follower, and study several properties and algorithmic problems related to this solution concept.
△ Less
Submitted 2 August, 2021; v1 submitted 13 July, 2020;
originally announced July 2020.
-
Monte Carlo Tree Search guided by Symbolic Advice for MDPs
Authors:
Damien Busatto-Gaston,
Debraj Chakraborty,
Jean-Francois Raskin
Abstract:
In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We augment the MCTS algorithm with the notion of symbolic advice, and show that its classical theoretical guarantees are maintained. Symbolic advice are used to bi…
▽ More
In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We augment the MCTS algorithm with the notion of symbolic advice, and show that its classical theoretical guarantees are maintained. Symbolic advice are used to bias the selection and simulation strategies of MCTS. We describe how to use QBF and SAT solvers to implement symbolic advice in an efficient way. We illustrate our new algorithm using the popular game Pac-Man and show that the performances of our algorithm exceed those of plain MCTS as well as the performances of human players.
△ Less
Submitted 16 July, 2020; v1 submitted 8 June, 2020;
originally announced June 2020.
-
Safe Learning for Near Optimal Scheduling
Authors:
Damien Busatto-Gaston,
Debraj Chakraborty,
Shibashis Guha,
Guillermo A. Pérez,
Jean-François Raskin
Abstract:
In this paper, we investigate the combination of synthesis, model-based learning, and online sampling techniques to obtain safe and near-optimal schedulers for a preemptible task scheduling problem. Our algorithms can handle Markov decision processes (MDPs) that have 1020 states and beyond which cannot be handled with state-of-the art probabilistic model-checkers. We provide probably approximately…
▽ More
In this paper, we investigate the combination of synthesis, model-based learning, and online sampling techniques to obtain safe and near-optimal schedulers for a preemptible task scheduling problem. Our algorithms can handle Markov decision processes (MDPs) that have 1020 states and beyond which cannot be handled with state-of-the art probabilistic model-checkers. We provide probably approximately correct (PAC) guarantees for learning the model. Additionally, we extend Monte-Carlo tree search with advice, computed using safety games or obtained using the earliest-deadline-first scheduler, to safely explore the learned model online. Finally, we implemented and compared our algorithms empirically against shielded deep Q-learning on large task systems.
△ Less
Submitted 13 July, 2021; v1 submitted 19 May, 2020;
originally announced May 2020.
-
Mixing Probabilistic and non-Probabilistic Objectives in Markov Decision Processes
Authors:
Raphaël Berthon,
Shibashis Guha,
Jean-François Raskin
Abstract:
In this paper, we consider algorithms to decide the existence of strategies in MDPs for Boolean combinations of objectives. These objectives are omega-regular properties that need to be enforced either surely, almost surely, existentially, or with non-zero probability. In this setting, relevant strategies are randomized infinite memory strategies: both infinite memory and randomization may be need…
▽ More
In this paper, we consider algorithms to decide the existence of strategies in MDPs for Boolean combinations of objectives. These objectives are omega-regular properties that need to be enforced either surely, almost surely, existentially, or with non-zero probability. In this setting, relevant strategies are randomized infinite memory strategies: both infinite memory and randomization may be needed to play optimally. We provide algorithms to solve the general case of Boolean combinations and we also investigate relevant subcases. We further report on complexity bounds for these problems.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.
-
The Adversarial Stackelberg Value in Quantitative Games
Authors:
Emmanuel Filiot,
Raffaella Gentilini,
Jean-François Raskin
Abstract:
In this paper, we study the notion of adversarial Stackelberg value for two-player non-zero sum games played on bi-weighted graphs with the mean-payoff and the discounted sum functions. The adversarial Stackelberg value of Player 0 is the largest value that Player 0 can obtain when announcing her strategy to Player 1 which in turn responds with any of his best response. For the mean-payoff functio…
▽ More
In this paper, we study the notion of adversarial Stackelberg value for two-player non-zero sum games played on bi-weighted graphs with the mean-payoff and the discounted sum functions. The adversarial Stackelberg value of Player 0 is the largest value that Player 0 can obtain when announcing her strategy to Player 1 which in turn responds with any of his best response. For the mean-payoff function, we show that the adversarial Stackelberg value is not always achievable but epsilon-optimal strategies exist. We show how to compute this value and prove that the associated threshold problem is in NP. For the discounted sum payoff function, we draw a link with the target discounted sum problem which explains why the problem is difficult to solve for this payoff function. We also provide solutions to related gap problems.
△ Less
Submitted 4 May, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
Learning Non-Markovian Reward Models in MDPs
Authors:
Gavin Rens,
Jean-François Raskin
Abstract:
There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks. In other words, the reward that the agent receives is non-Markovian. One natural and quite general way to represent history-dependent rewards is via a Mealy machine; a finite state automaton that produces output sequences (rewards in our case) from input sequences (state/action…
▽ More
There are situations in which an agent should receive rewards only after having accomplished a series of previous tasks. In other words, the reward that the agent receives is non-Markovian. One natural and quite general way to represent history-dependent rewards is via a Mealy machine; a finite state automaton that produces output sequences (rewards in our case) from input sequences (state/action observations in our case). In our formal setting, we consider a Markov decision process (MDP) that models the dynamic of the environment in which the agent evolves and a Mealy machine synchronised with this MDP to formalise the non-Markovian reward function. While the MDP is known by the agent, the reward function is unknown from the agent and must be learnt.
Learning non-Markov reward functions is a challenge. Our approach to overcome this challenging problem is a careful combination of the Angluin's L* active learning algorithm to learn finite automata, testing techniques for establishing conformance of finite model hypothesis and optimisation techniques for computing optimal strategies in Markovian (immediate) reward MDPs. We also show how our framework can be combined with classical heuristics such as Monte Carlo Tree Search. We illustrate our algorithms and a preliminary implementation on two typical examples for AI.
△ Less
Submitted 25 January, 2020;
originally announced January 2020.
-
Proceedings Tenth International Symposium on Games, Automata, Logics, and Formal Verification
Authors:
Jérôme Leroux,
Jean-Francois Raskin
Abstract:
This volume contains the proceedings of the Tenth International Symposium on Games, Automata, Logic and Formal Verification (GandALF 2019). The symposium took place in Bordeaux, France, from the 2nd to the 3rd of September 2010. The GandALF symposium was established by a group of Italian computer scientists interested in mathematical logic, automata theory, game theory, and their applications to t…
▽ More
This volume contains the proceedings of the Tenth International Symposium on Games, Automata, Logic and Formal Verification (GandALF 2019). The symposium took place in Bordeaux, France, from the 2nd to the 3rd of September 2010. The GandALF symposium was established by a group of Italian computer scientists interested in mathematical logic, automata theory, game theory, and their applications to the specification, design, and verification of complex systems. Its aim is to provide a forum where people from different areas, and possibly with different backgrounds, can fruitfully interact. GandALF has a truly international spirit, as witnessed by the composition of the program and steering committee and by the country distribution of the submitted papers.
△ Less
Submitted 12 September, 2019;
originally announced September 2019.
-
Partial Solvers for Generalized Parity Games
Authors:
Véronique Bruyère,
Guillermo A. Pérez,
Jean-François Raskin,
Clément Tamines
Abstract:
Parity games have been broadly studied in recent years for their applications to controller synthesis and verification. In practice, partial solvers for parity games that execute in polynomial time, while incomplete, can solve most games in publicly available benchmark suites. In this paper, we combine those partial solvers with the classical recursive algorithm for parity games due to Zielonka. W…
▽ More
Parity games have been broadly studied in recent years for their applications to controller synthesis and verification. In practice, partial solvers for parity games that execute in polynomial time, while incomplete, can solve most games in publicly available benchmark suites. In this paper, we combine those partial solvers with the classical recursive algorithm for parity games due to Zielonka. We also extend partial solvers to generalized parity games that are games with conjunction of parity objectives. We have implemented those algorithms and evaluated them on a large set of benchmarks proposed in the last LTL synthesis competition.
△ Less
Submitted 20 July, 2019; v1 submitted 16 July, 2019;
originally announced July 2019.
-
Energy mean-payoff games
Authors:
Véronique Bruyère,
Quentin Hautem,
Mickael Randour,
Jean-François Raskin
Abstract:
In this paper, we study one-player and two-player energy mean-payoff games. Energy mean-payoff games are games of infinite duration played on a finite graph with edges labeled by 2-dimensional weight vectors. The objective of the first player (the protagonist) is to satisfy an energy objective on the first dimension and a mean-payoff objective on the second dimension. We show that optimal strategi…
▽ More
In this paper, we study one-player and two-player energy mean-payoff games. Energy mean-payoff games are games of infinite duration played on a finite graph with edges labeled by 2-dimensional weight vectors. The objective of the first player (the protagonist) is to satisfy an energy objective on the first dimension and a mean-payoff objective on the second dimension. We show that optimal strategies for the first player may require infinite memory while optimal strategies for the second player (the antagonist) do not require memory. In the one-player case (where only the first player has choices), the problem of deciding who is the winner can be solved in polynomial time while for the two-player case we show co-NP membership and we give effective constructions for the infinite-memory optimal strategies of the protagonist.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
-
The Complexity of Subgame Perfect Equilibria in Quantitative Reachability Games
Authors:
Thomas Brihaye,
Véronique Bruyère,
Aline Goeminne,
Jean-François Raskin,
Marie van den Bogaard
Abstract:
We study multiplayer quantitative reachability games played on a finite directed graph, where the objective of each player is to reach his target set of vertices as quickly as possible. Instead of the well-known notion of Nash equilibrium (NE), we focus on the notion of subgame perfect equilibrium (SPE), a refinement of NE well-suited in the framework of games played on graphs. It is known that th…
▽ More
We study multiplayer quantitative reachability games played on a finite directed graph, where the objective of each player is to reach his target set of vertices as quickly as possible. Instead of the well-known notion of Nash equilibrium (NE), we focus on the notion of subgame perfect equilibrium (SPE), a refinement of NE well-suited in the framework of games played on graphs. It is known that there always exists an SPE in quantitative reachability games and that the constrained existence problem is decidable. We here prove that this problem is PSPACE-complete. To obtain this result, we propose a new algorithm that iteratively builds a set of constraints characterizing the set of SPE outcomes in quantitative reachability games. This set of constraints is obtained by iterating an operator that reinforces the constraints up to obtaining a fixpoint. With this fixpoint, the set of SPE outcomes can be represented by a finite graph of size at most exponential. A careful inspection of the computation allows us to establish PSPACE membership.
△ Less
Submitted 4 November, 2020; v1 submitted 2 May, 2019;
originally announced May 2019.
-
Detection mechanism in highly sensitive ZnO nanowires network gas sensors
Authors:
Nohora Caicedo,
Renaud Leturcq,
Jean-Pierre Raskin,
Denis Flandre,
Damien Lenoble
Abstract:
Metal-oxide nanowires are showing a great interest in the domain of gas sensing due to their large response even at a low temperature, enabling low-power gas sensors. However their response is still not fully understood, and mainly restricted to the linear response regime, which limits the design of appropriate sensors for specific applications. Here we analyse the non-linear response of a sensor…
▽ More
Metal-oxide nanowires are showing a great interest in the domain of gas sensing due to their large response even at a low temperature, enabling low-power gas sensors. However their response is still not fully understood, and mainly restricted to the linear response regime, which limits the design of appropriate sensors for specific applications. Here we analyse the non-linear response of a sensor based on ZnO nanowires network, both as a function of the device geometry and as a response to oxygen exposure. Using an appropriate model, we disentangle the contribution of the nanowire resistance and of the junctions between nanowires in the network. The applied model shows a very good consistency with the experimental data, allowing us to demonstrate that the response to oxygen at room temperature is dominated by the barrier potential at low bias voltage, and that the nanowire resistance starts to play a role at higher bias voltage. This analysis allows us to find the appropriate device geometry and working point in order to optimize the sensitivity. Such analysis is important for providing design rules, not only for sensing devices, but also for applications in electronics and opto-electronics using nanostructures networks with different materials and geometries.
△ Less
Submitted 9 April, 2019;
originally announced April 2019.
-
Monadic Second-Order Logic with Path-Measure Quantifier is Undecidable
Authors:
Raphaël Berthon,
Emmanuel Filiot,
Shibashis Guha,
Bastien Maubert,
Aniello Murano,
Laureline Pinault,
Jean-François Raskin,
Sasha Rubin
Abstract:
We prove that the theory of Monadic Second-Order logic (MSO) of the infinite binary tree extended with qualitative path-measure quantifier is undecidable. This quantifier says that the set of infinite paths in the tree that satisfies some formula has Lebesgue-measure one. To do this we prove that the emptiness problem of qualitative universal parity tree automata is undecidable. Qualitative means…
▽ More
We prove that the theory of Monadic Second-Order logic (MSO) of the infinite binary tree extended with qualitative path-measure quantifier is undecidable. This quantifier says that the set of infinite paths in the tree that satisfies some formula has Lebesgue-measure one. To do this we prove that the emptiness problem of qualitative universal parity tree automata is undecidable. Qualitative means that a run of a tree automaton is accepting if the set of paths in the run that satisfy the acceptance condition has Lebesgue-measure one.
△ Less
Submitted 15 February, 2019; v1 submitted 14 January, 2019;
originally announced January 2019.
-
Expected Window Mean-Payoff
Authors:
Benjamin Bordais,
Shibashis Guha,
Jean-François Raskin
Abstract:
In the window mean-payoff objective, given an infinite path, instead of considering a long run average, we consider the minimum payoff that can be ensured at every position of the path over a finite window that slides over the entire path. Chatterjee et al. studied the problem to decide if in a two-player game, Player 1 has a strategy to ensure a window mean-payoff of at least 0.
In this work, w…
▽ More
In the window mean-payoff objective, given an infinite path, instead of considering a long run average, we consider the minimum payoff that can be ensured at every position of the path over a finite window that slides over the entire path. Chatterjee et al. studied the problem to decide if in a two-player game, Player 1 has a strategy to ensure a window mean-payoff of at least 0.
In this work, we consider a function that given a path returns the supremum value of the window mean-payoff that can be ensured over the path and we show how to compute its expected value in Markov chains and Markov decision processes. We consider two variants of the function: Fixed window mean-payoff in which a fixed window length $l_{max}$ is provided; and Bounded window mean-payoff in which we compute the maximum possible value of the window mean-payoff over all possible window lengths. Further, for both variants, we consider (i) a direct version of the problem where for each path, the payoff that can be ensured from its very beginning and (ii) a non-direct version that is the prefix independent counterpart of the direct version of the problem.
△ Less
Submitted 5 December, 2019; v1 submitted 21 December, 2018;
originally announced December 2018.
-
A Pattern Logic for Automata with Outputs
Authors:
Emmanuel Filiot,
Nicolas Mazzocchi,
Jean-François Raskin
Abstract:
We introduce a logic to express structural properties of automata with string inputs and, possibly, outputs in some monoid. In this logic, the set of predicates talking about the output values is parametric, and we provide sufficient conditions on the predicates under which the model-checking problem is decidable. We then consider three particular automata models (finite automata, transducers and…
▽ More
We introduce a logic to express structural properties of automata with string inputs and, possibly, outputs in some monoid. In this logic, the set of predicates talking about the output values is parametric, and we provide sufficient conditions on the predicates under which the model-checking problem is decidable. We then consider three particular automata models (finite automata, transducers and automata weighted by integers -- sum-automata --) and instantiate the generic logic for each of them. We give tight complexity results for the three logics and the model-checking problem, depending on whether the formula is fixed or not. We study the expressiveness of our logics by expressing classical structural patterns characterising for instance finite ambiguity and polynomial ambiguity in the case of finite automata, determinisability and finite-valuedness in the case of transducers and sum-automata. Consequently to our complexity results, we directly obtain that these classical properties can be decided in PTIME.
△ Less
Submitted 8 October, 2018;
originally announced October 2018.
-
Constrained Existence Problem for Weak Subgame Perfect Equilibria with $ω$-Regular Boolean Objectives
Authors:
Thomas Brihaye,
Véronique Bruyère,
Aline Goeminne,
Jean-François Raskin
Abstract:
We study multiplayer turn-based games played on a finite directed graph such that each player aims at satisfying an omega-regular Boolean objective. Instead of the well-known notions of Nash equilibrium (NE) and subgame perfect equilibrium (SPE), we focus on the recent notion of weak subgame perfect equilibrium (weak SPE), a refinement of SPE. In this setting, players who deviate can only use the…
▽ More
We study multiplayer turn-based games played on a finite directed graph such that each player aims at satisfying an omega-regular Boolean objective. Instead of the well-known notions of Nash equilibrium (NE) and subgame perfect equilibrium (SPE), we focus on the recent notion of weak subgame perfect equilibrium (weak SPE), a refinement of SPE. In this setting, players who deviate can only use the subclass of strategies that differ from the original one on a finite number of histories. We are interested in the constrained existence problem for weak SPEs. We provide a complete characterization of the computational complexity of this problem: it is P-complete for Explicit Muller objectives, NP-complete for Co-Büchi, Parity, Muller, Rabin, and Streett objectives, and PSPACE-complete for Reachability and Safety objectives (we only prove NP-membership for Büchi objectives). We also show that the constrained existence problem is fixed parameter tractable and is polynomial when the number of players is fixed. All these results are based on a fine analysis of a fixpoint algorithm that computes the set of possible payoff profiles underlying weak SPEs.
△ Less
Submitted 9 September, 2018;
originally announced September 2018.
-
Constrained existence problem for weak subgame perfect equilibria with omega-regular Boolean objectives (full version)
Authors:
Thomas Brihaye,
Véronique Bruyère,
Aline Goeminne,
Jean-François Raskin
Abstract:
We study multiplayer turn-based games played on a finite directed graph such that each player aims at satisfying an omega-regular Boolean objective. Instead of the well-known notions of Nash equilibrium (NE) and subgame perfect equilibrium (SPE), we focus on the recent notion of weak subgame perfect equilibrium (weak SPE), a refinement of SPE. In this setting, players who deviate can only use the…
▽ More
We study multiplayer turn-based games played on a finite directed graph such that each player aims at satisfying an omega-regular Boolean objective. Instead of the well-known notions of Nash equilibrium (NE) and subgame perfect equilibrium (SPE), we focus on the recent notion of weak subgame perfect equilibrium (weak SPE), a refinement of SPE. In this setting, players who deviate can only use the subclass of strategies that differ from the original one on a finite number of histories. We are interested in the constrained existence problem for weak SPEs. We provide a complete characterization of the computational complexity of this problem: it is P-complete for Explicit Muller objectives, NP-complete for Co-Büchi, Parity, Muller, Rabin, and Streett objectives, and PSPACE-complete for Reachability and Safety objectives (we only prove NP-membership for Büchi objectives). We also show that the constrained existence problem is fixed parameter tractable and is polynomial when the number of players is fixed. All these results are based on a fine analysis of a fixpoint algorithm that computes the set of possible payoff profiles underlying weak SPEs.
△ Less
Submitted 15 August, 2018; v1 submitted 14 June, 2018;
originally announced June 2018.
-
Beyond admissibility: Dominance between chains of strategies
Authors:
Nicolas Basset,
Ismaël Jecker,
Arno Pauly,
Jean-François Raskin,
Marie Van den Bogaard
Abstract:
Admissible strategies, i.e. those that are not dominated by any other strategy, are a typical rationality notion in game theory. In many classes of games this is justified by results showing that any strategy is admissible or dominated by an admissible strategy. However, in games played on finite graphs with quantitative objectives (as used for reactive synthesis), this is not the case.
We consi…
▽ More
Admissible strategies, i.e. those that are not dominated by any other strategy, are a typical rationality notion in game theory. In many classes of games this is justified by results showing that any strategy is admissible or dominated by an admissible strategy. However, in games played on finite graphs with quantitative objectives (as used for reactive synthesis), this is not the case.
We consider increasing chains of strategies instead to recover a satisfactory rationality notion based on dominance in such games. We start with some order-theoretic considerations establishing sufficient criteria for this to work. We then turn our attention to generalised safety/reachability games as a particular application. We propose the notion of maximal uniform chain as the desired dominance-based rationality concept in these games. Decidability of some fundamental questions about uniform chains is established.
△ Less
Submitted 29 May, 2018;
originally announced May 2018.
-
Learning-Based Mean-Payoff Optimization in an Unknown MDP under Omega-Regular Constraints
Authors:
Jan Křetínský,
Guillermo A. Pérez,
Jean-François Raskin
Abstract:
We formalize the problem of maximizing the mean-payoff value with high probability while satisfying a parity objective in a Markov decision process (MDP) with unknown probabilistic transition function and unknown reward function. Assuming the support of the unknown transition function and a lower bound on the minimal transition probability are known in advance, we show that in MDPs consisting of a…
▽ More
We formalize the problem of maximizing the mean-payoff value with high probability while satisfying a parity objective in a Markov decision process (MDP) with unknown probabilistic transition function and unknown reward function. Assuming the support of the unknown transition function and a lower bound on the minimal transition probability are known in advance, we show that in MDPs consisting of a single end component, two combinations of guarantees on the parity and mean-payoff objectives can be achieved depending on how much memory one is willing to use. (i) For all $ε$ and $γ$ we can construct an online-learning finite-memory strategy that almost-surely satisfies the parity objective and which achieves an $ε$-optimal mean payoff with probability at least $1 - γ$. (ii) Alternatively, for all $ε$ and $γ$ there exists an online-learning infinite-memory strategy that satisfies the parity objective surely and which achieves an $ε$-optimal mean payoff with probability at least $1 - γ$. We extend the above results to MDPs consisting of more than one end component in a natural way. Finally, we show that the aforementioned guarantees are tight, i.e. there are MDPs for which stronger combinations of the guarantees cannot be ensured.
△ Less
Submitted 23 August, 2018; v1 submitted 24 April, 2018;
originally announced April 2018.
-
The 4th Reactive Synthesis Competition (SYNTCOMP 2017): Benchmarks, Participants & Results
Authors:
Swen Jacobs,
Nicolas Basset,
Roderick Bloem,
Romain Brenguier,
Maximilien Colange,
Peter Faymonville,
Bernd Finkbeiner,
Ayrat Khalimov,
Felix Klein,
Thibaud Michaud,
Guillermo A. Pérez,
Jean-François Raskin,
Ocan Sankur,
Leander Tentrup
Abstract:
We report on the fourth reactive synthesis competition (SYNTCOMP 2017). We introduce two new benchmark classes that have been added to the SYNTCOMP library, and briefly describe the benchmark selection, evaluation scheme and the experimental setup of SYNTCOMP 2017. We present the participants of SYNTCOMP 2017, with a focus on changes with respect to the previous years and on the two completely new…
▽ More
We report on the fourth reactive synthesis competition (SYNTCOMP 2017). We introduce two new benchmark classes that have been added to the SYNTCOMP library, and briefly describe the benchmark selection, evaluation scheme and the experimental setup of SYNTCOMP 2017. We present the participants of SYNTCOMP 2017, with a focus on changes with respect to the previous years and on the two completely new tools that have entered the competition. Finally, we present and analyze the results of our experimental evaluation, including a ranking of tools with respect to quantity and quality of solutions.
△ Less
Submitted 28 November, 2017;
originally announced November 2017.
-
Parameterized complexity of games with monotonically ordered ω-regular objectives
Authors:
Véronique Bruyère,
Quentin Hautem,
Jean-François Raskin
Abstract:
In recent years, two-player zero-sum games with multiple objectives have received a lot of interest as a model for the synthesis of complex reactive systems. In this framework, Player 1 wins if he can ensure that all objectives are satisfied against any behavior of Player 2. When this is not possible to satisfy all the objectives at once, an alternative is to use some preorder on the objectives ac…
▽ More
In recent years, two-player zero-sum games with multiple objectives have received a lot of interest as a model for the synthesis of complex reactive systems. In this framework, Player 1 wins if he can ensure that all objectives are satisfied against any behavior of Player 2. When this is not possible to satisfy all the objectives at once, an alternative is to use some preorder on the objectives according to which subset of objectives Player 1 wants to satisfy. For example, it is often natural to provide more significance to one objective over another, a situation that can be modelled with lexicographically ordered objectives for instance. Inspired by recent work on concurrent games with multiple ω-regular objectives by Bouyer et al., we investigate in detail turned-based games with monotonically ordered and ω-regular objectives. We study the threshold problem which asks whether player 1 can ensure a payoff greater than or equal to a given threshold w.r.t. a given monotonic preorder. As the number of objectives is usually much smaller than the size of the game graph, we provide a parametric complexity analysis and we show that our threshold problem is in FPT for all monotonic preorders and all classical types of ω-regular objectives. We also provide polynomial time algorithms for Büchi, coBüchi and explicit Muller objectives for a large subclass of monotonic preorders that includes among others the lexicographic preorder. In the particular case of lexicographic preorder, we also study the complexity of computing the values and the memory requirements of optimal strategies.
△ Less
Submitted 2 July, 2018; v1 submitted 19 July, 2017;
originally announced July 2017.
-
Decidable Weighted Expressions with Presburger Combinators
Authors:
Emmanuel Filiot,
Nicolas Mazzocchi,
Jean-François Raskin
Abstract:
In this paper, we investigate the expressive power and the algorithmic properties of weighted expressions, which define functions from finite words to integers. First, we consider a slight extension of an expression formalism, introduced by Chatterjee. et. al. in the context of infinite words, by which to combine values given by unambiguous (max,+)-automata, using Presburger arithmetic. We show th…
▽ More
In this paper, we investigate the expressive power and the algorithmic properties of weighted expressions, which define functions from finite words to integers. First, we consider a slight extension of an expression formalism, introduced by Chatterjee. et. al. in the context of infinite words, by which to combine values given by unambiguous (max,+)-automata, using Presburger arithmetic. We show that important decision problems such as emptiness, universality and comparison are PSpace-c for these expressions. We then investigate the extension of these expressions with Kleene star. This allows to iterate an expression over smaller fragments of the input word, and to combine the results by taking their iterated sum. The decision problems turn out to be undecidable, but we introduce the decidable and still expressive class of synchronised expressions.
△ Less
Submitted 27 June, 2017;
originally announced June 2017.
-
Admissibility in Concurrent Games
Authors:
Nicolas Basset,
Gilles Geeraerts,
Jean-François Raskin,
Ocan Sankur
Abstract:
In this paper, we study the notion of admissibility for randomised strategies in concurrent games. Intuitively, an admissible strategy is one where the player plays `as well as possible', because there is no other strategy that dominates it, i.e., that wins (almost surely) against a super set of adversarial strategies. We prove that admissible strategies always exist in concurrent games, and we ch…
▽ More
In this paper, we study the notion of admissibility for randomised strategies in concurrent games. Intuitively, an admissible strategy is one where the player plays `as well as possible', because there is no other strategy that dominates it, i.e., that wins (almost surely) against a super set of adversarial strategies. We prove that admissible strategies always exist in concurrent games, and we characterise them precisely. Then, when the objectives of the players are omega-regular, we show how to perform assume-admissible synthesis, i.e., how to compute admissible strategies that win (almost surely) under the hypothesis that the other players play admissible
△ Less
Submitted 21 February, 2017;
originally announced February 2017.
-
Threshold Constraints with Guarantees for Parity Objectives in Markov Decision Processes
Authors:
Raphaël Berthon,
Mickael Randour,
Jean-François Raskin
Abstract:
The beyond worst-case synthesis problem was introduced recently by Bruyère et al. [BFRR14]: it aims at building system controllers that provide strict worst-case performance guarantees against an antagonistic environment while ensuring higher expected performance against a stochastic model of the environment. Our work extends the framework of [BFRR14] and follow-up papers, which focused on quantit…
▽ More
The beyond worst-case synthesis problem was introduced recently by Bruyère et al. [BFRR14]: it aims at building system controllers that provide strict worst-case performance guarantees against an antagonistic environment while ensuring higher expected performance against a stochastic model of the environment. Our work extends the framework of [BFRR14] and follow-up papers, which focused on quantitative objectives, by addressing the case of $ω$-regular conditions encoded as parity objectives, a natural way to represent functional requirements of systems.
We build strategies that satisfy a main parity objective on all plays, while ensuring a secondary one with sufficient probability. This setting raises new challenges in comparison to quantitative objectives, as one cannot easily mix different strategies without endangering the functional properties of the system. We establish that, for all variants of this problem, deciding the existence of a strategy lies in ${\sf NP} \cap {\sf coNP}$, the same complexity class as classical parity games. Hence, our framework provides additional modeling power while staying in the same complexity class.
[BFRR14] Véronique Bruyère, Emmanuel Filiot, Mickael Randour, and Jean-François Raskin. Meet your expectations with guarantees: Beyond worst-case synthesis in quantitative games. In Ernst W. Mayr and Natacha Portier, editors, 31st International Symposium on Theoretical Aspects of Computer Science, STACS 2014, March 5-8, 2014, Lyon, France, volume 25 of LIPIcs, pages 199-213. Schloss Dagstuhl - Leibniz - Zentrum fuer Informatik, 2014.
△ Less
Submitted 27 April, 2017; v1 submitted 17 February, 2017;
originally announced February 2017.