-
Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent
Authors:
Yuxiao Chen,
Sander Tonkens,
Marco Pavone
Abstract:
Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility. Recently, with the advent of large language models (LLMs), an additional desirable feature for traffic models is LLM compatibility. We present Categorical Traffic Transfo…
▽ More
Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility. Recently, with the advent of large language models (LLMs), an additional desirable feature for traffic models is LLM compatibility. We present Categorical Traffic Transformer (CTT), a traffic model that outputs both continuous trajectory predictions and tokenized categorical predictions (lane modes, homotopies, etc.). The most outstanding feature of CTT is its fully interpretable latent space, which enables direct supervision of the latent variable from the ground truth during training and avoids mode collapse completely. As a result, CTT can generate diverse behaviors conditioned on different latent modes with semantic meanings while beating SOTA on prediction accuracy. In addition, CTT's ability to input and output tokens enables integration with LLMs for common-sense reasoning and zero-shot generalization.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Patching Neural Barrier Functions Using Hamilton-Jacobi Reachability
Authors:
Sander Tonkens,
Alex Toofanian,
Zhizhen Qin,
Sicun Gao,
Sylvia Herbert
Abstract:
Learning-based control algorithms have led to major advances in robotics at the cost of decreased safety guarantees. Recently, neural networks have also been used to characterize safety through the use of barrier functions for complex nonlinear systems. Learned barrier functions approximately encode and enforce a desired safety constraint through a value function, but do not provide any formal gua…
▽ More
Learning-based control algorithms have led to major advances in robotics at the cost of decreased safety guarantees. Recently, neural networks have also been used to characterize safety through the use of barrier functions for complex nonlinear systems. Learned barrier functions approximately encode and enforce a desired safety constraint through a value function, but do not provide any formal guarantees. In this paper, we propose a local dynamic programming (DP) based approach to "patch" an almost-safe learned barrier at potentially unsafe points in the state space. This algorithm, HJ-Patch, obtains a novel barrier that provides formal safety guarantees, yet retains the global structure of the learned barrier. Our local DP based reachability algorithm, HJ-Patch, updates the barrier function "minimally" at points that both (a) neighbor the barrier safety boundary and (b) do not satisfy the safety condition. We view this as a key step to bridging the gap between learning-based barrier functions and Hamilton-Jacobi reachability analysis, providing a framework for further integration of these approaches. We demonstrate that for well-trained barriers we reduce the computational load by 2 orders of magnitude with respect to standard DP-based reachability, and demonstrate scalability to a 6-dimensional system, which is at the limit of standard DP-based reachability.
△ Less
Submitted 19 April, 2023;
originally announced April 2023.
-
Refining Control Barrier Functions through Hamilton-Jacobi Reachability
Authors:
Sander Tonkens,
Sylvia Herbert
Abstract:
Safety filters based on Control Barrier Functions (CBFs) have emerged as a practical tool for the safety-critical control of autonomous systems. These approaches encode safety through a value function and enforce safety by imposing a constraint on the time derivative of this value function. However, synthesizing a valid CBF that is not overly conservative in the presence of input constraints is a…
▽ More
Safety filters based on Control Barrier Functions (CBFs) have emerged as a practical tool for the safety-critical control of autonomous systems. These approaches encode safety through a value function and enforce safety by imposing a constraint on the time derivative of this value function. However, synthesizing a valid CBF that is not overly conservative in the presence of input constraints is a notorious challenge. In this work, we propose refining a candidate CBF using formal verification methods to obtain a valid CBF. In particular, we update an expert-synthesized or backup CBF using dynamic programming (DP) based reachability analysis. Our framework, refineCBF, guarantees that with every DP iteration the obtained CBF is provably at least as safe as the prior iteration and converges to a valid CBF. Therefore, refineCBF can be used in-the-loop for robotic systems. We demonstrate the practicality of our method to enhance safety and/or reduce conservativeness on a range of nonlinear control-affine systems using various CBF synthesis techniques in simulation.
△ Less
Submitted 19 August, 2022; v1 submitted 26 April, 2022;
originally announced April 2022.
-
Optimizing Vaccine Allocation Strategies in Pandemic Outbreaks: An Optimal Control Approach
Authors:
Sander Tonkens,
Paul de Klaver,
Mauro Salazar
Abstract:
Since early 2020, the world has been dealing with a raging pandemic outbreak: COVID-19. A year later, vaccines have become accessible, but in limited quantities, so that governments needed to devise a strategy to decide which part of the population to prioritize when assigning the available doses, and how to manage the interval between doses for multi-dose vaccines. In this paper, we present an op…
▽ More
Since early 2020, the world has been dealing with a raging pandemic outbreak: COVID-19. A year later, vaccines have become accessible, but in limited quantities, so that governments needed to devise a strategy to decide which part of the population to prioritize when assigning the available doses, and how to manage the interval between doses for multi-dose vaccines. In this paper, we present an optimization framework to address the dynamic double-dose vaccine allocation problem whereby the available vaccine doses must be administered to different age-groups to minimize specific societal objectives. In particular, we first identify an age-dependent Susceptible-Exposed-Infected-Recovered (SEIR) epidemic model including an extension capturing partially and fully vaccinated people, whereby we account for age-dependent immunity and infectiousness levels together with disease severity. Second, we leverage our model to frame the dynamic age-dependent vaccine allocation problem for different societal objectives, such as the minimization of infections or fatalities, and solve it with nonlinear programming techniques. Finally, we carry out a numerical case study with real-world data from The Netherlands. Our results show how different societal objectives can significantly alter the optimal vaccine allocation strategy. For instance, we find that minimizing the overall number of infections results in delaying second doses, whilst to minimize fatalities it is important to fully vaccinate the elderly first.
△ Less
Submitted 12 April, 2022; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Soft Robot Optimal Control Via Reduced Order Finite Element Models
Authors:
Sander Tonkens,
Joseph Lorenzetti,
Marco Pavone
Abstract:
Finite element methods have been successfully used to develop physics-based models of soft robots that capture the nonlinear dynamic behavior induced by continuous deformation. These high-fidelity models are therefore ideal for designing controllers for complex dynamic tasks such as trajectory optimization and trajectory tracking. However, finite element models are also typically very high-dimensi…
▽ More
Finite element methods have been successfully used to develop physics-based models of soft robots that capture the nonlinear dynamic behavior induced by continuous deformation. These high-fidelity models are therefore ideal for designing controllers for complex dynamic tasks such as trajectory optimization and trajectory tracking. However, finite element models are also typically very high-dimensional, which makes real-time control challenging. In this work we propose an approach for finite element model-based control of soft robots that leverages model order reduction techniques to significantly increase computational efficiency. In particular, a constrained optimal control problem is formulated based on a nonlinear reduced order finite element model and is solved via sequential convex programming. This approach is demonstrated through simulation of a cable-driven soft robot for a constrained trajectory tracking task, where a 9768-dimensional finite element model is used for controller design.
△ Less
Submitted 26 March, 2021; v1 submitted 3 November, 2020;
originally announced November 2020.
