Showing 1–50 of 50 results for author: Malikopoulos, A

On Mobility Equity and the Promise of Emerging Transportation Systems

Authors: Heeseung Bang, Aditya Dave, Filippos N. Tzortzoglou, Shanting Wang, Andreas A. Malikopoulos

Abstract: This paper introduces a mobility equity metric (MEM) for evaluating fairness and accessibility in multi-modal intelligent transportation systems. The MEM simultaneously accounts for service accessibility and transportation costs across different modes of transportation and social demographics. We provide a data-driven validation of the proposed MEM to characterize the impact of various parameters… ▽ More This paper introduces a mobility equity metric (MEM) for evaluating fairness and accessibility in multi-modal intelligent transportation systems. The MEM simultaneously accounts for service accessibility and transportation costs across different modes of transportation and social demographics. We provide a data-driven validation of the proposed MEM to characterize the impact of various parameters in the metric across cities in the U.S. We subsequently develop a routing framework that aims to optimize MEM within a transportation network containing both public transit and private vehicles. Within this framework, a system planner provides routing suggestions to vehicles across all modes of transportation to maximize MEM. We evaluate our approach through numerical simulations, analyzing the impact of travel demands and compliance of private vehicles. This work provides insights into designing transportation systems that are not only efficient but also equitable, ensuring fair access to essential services across diverse populations. △ Less

Submitted 27 August, 2024; originally announced August 2024.

Comments: 14 pages, 15 figures

A Mobility Equity Metric for Multi-Modal Intelligent Transportation Systems

Authors: Heeseung Bang, Aditya Dave, Filippos N. Tzortzoglou, Andreas A. Malikopoulos

Abstract: In this paper, we introduce a metric to evaluate the equity in mobility and a routing framework to enhance the metric within multi-modal intelligent transportation systems. The mobility equity metric (MEM) simultaneously accounts for service accessibility and transportation costs to quantify the equity and fairness in a transportation network. Finally, we develop a system planner integrated with M… ▽ More In this paper, we introduce a metric to evaluate the equity in mobility and a routing framework to enhance the metric within multi-modal intelligent transportation systems. The mobility equity metric (MEM) simultaneously accounts for service accessibility and transportation costs to quantify the equity and fairness in a transportation network. Finally, we develop a system planner integrated with MEM that aims to distribute travel demand for the transportation network, resulting in a socially optimal mobility system. Our framework results in a transportation network that is efficient in terms of travel time, improves accessibility, and ensures equity in transportation. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: 6 pages, 7 figures

Journal ref: 17th IFAC Symposium on Control in Transportation Systems, Ayia Napa, Cyprus, 2024

Safe Merging in Mixed Traffic with Confidence

Authors: Heeseung Bang, Aditya Dave, Andreas A. Malikopoulos

Abstract: In this letter, we present an approach for learning human driving behavior, without relying on specific model structures or prior distributions, in a mixed-traffic environment where connected and automated vehicles (CAVs) coexist with human-driven vehicles (HDVs). We employ conformal prediction to obtain theoretical safety guarantees and use real-world traffic data to validate our approach. Then,… ▽ More In this letter, we present an approach for learning human driving behavior, without relying on specific model structures or prior distributions, in a mixed-traffic environment where connected and automated vehicles (CAVs) coexist with human-driven vehicles (HDVs). We employ conformal prediction to obtain theoretical safety guarantees and use real-world traffic data to validate our approach. Then, we design a controller that ensures effective merging of CAVs with HDVs with safety guarantees. We provide numerical simulations to illustrate the efficacy of the control approach. △ Less

Submitted 8 March, 2024; originally announced March 2024.

Comments: 6 pages, 5 figures

A Feasibility Analysis at Signal-Free Intersections

Authors: Filippos N. Tzortzoglou, Logan E. Beaver, Andreas A. Malikopoulos

Abstract: In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increas… ▽ More In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increases, the domain of the feasible trajectories decreases. We use concepts of numerical interpolation to identify appropriate polynomials that can serve as alternative trajectories of the CAVs, expanding the domain of the feasible CAV trajectories. We provide the conditions under which such polynomials exist. Finally, we demonstrate the efficacy of our approach through numerical simulations. △ Less

Submitted 8 March, 2024; originally announced March 2024.

A Framework for Effective AI Recommendations in Cyber-Physical-Human Systems

Authors: Aditya Dave, Heeseung Bang, Andreas A. Malikopoulos

Abstract: Many cyber-physical-human systems (CPHS) involve a human decision-maker who may receive recommendations from an artificial intelligence (AI) platform while holding the ultimate responsibility of making decisions. In such CPHS applications, the human decision-maker may depart from an optimal recommended decision and instead implement a different one for various reasons. In this letter, we develop a… ▽ More Many cyber-physical-human systems (CPHS) involve a human decision-maker who may receive recommendations from an artificial intelligence (AI) platform while holding the ultimate responsibility of making decisions. In such CPHS applications, the human decision-maker may depart from an optimal recommended decision and instead implement a different one for various reasons. In this letter, we develop a rigorous framework to overcome this challenge. In our framework, we consider that humans may deviate from AI recommendations as they perceive and interpret the system's state in a different way than the AI platform. We establish the structural properties of optimal recommendation strategies and develop an approximate human model (AHM) used by the AI. We provide theoretical bounds on the optimality gap that arises from an AHM and illustrate the efficacy of our results in a numerical example. △ Less

Submitted 8 March, 2024; originally announced March 2024.

Journal ref: IEEE Control Systems Letters (L-CSS), Vol 8, 2024

Controller Adaptation via Learning Solutions of Contextual Bayesian Optimization

Authors: Viet-Anh Le, Andreas A. Malikopoulos

Abstract: In this letter, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynamical systems operating in different environments or conditions represented by contextual parameters. The overarching goal is to identify the controller parameters that maximize th… ▽ More In this letter, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynamical systems operating in different environments or conditions represented by contextual parameters. The overarching goal is to identify the controller parameters that maximize the controlled system's performance, given different realizations of the contextual parameters. We formulate a contextual Bayesian optimization problem in which the solution is actively learned using Gaussian processes to approximate the controller adaptation strategy. We demonstrate the efficacy of the proposed framework with a simulation-to-real example. We learn the optimal weighting strategy of a model predictive control for connected and automated vehicles interacting with human-driven vehicles from simulations and then deploy it in a real-time experiment. △ Less

Submitted 7 March, 2024; originally announced March 2024.

Comments: first submission to LCSS-CDC 2024

Optimal trajectory planning meets network-level routing: Integrated control framework for emerging mobility systems

Authors: Heeseung Bang, Andreas A. Malikopoulos

Abstract: In this paper, we introduce a hierarchical decision-making framework for emerging mobility systems. Despite numerous studies focusing on optimizing vehicle flow, practical feasibility has often been overlooked. To address this gap, we present a route-recovery method and energy-optimal trajectory planning tailored for connected and automated vehicles (CAVs) to ensure the realization of optimal flow… ▽ More In this paper, we introduce a hierarchical decision-making framework for emerging mobility systems. Despite numerous studies focusing on optimizing vehicle flow, practical feasibility has often been overlooked. To address this gap, we present a route-recovery method and energy-optimal trajectory planning tailored for connected and automated vehicles (CAVs) to ensure the realization of optimal flow. Our approach identifies the optimal vehicle flow to minimize total travel time while considering consistent mobility demands in urban settings. We deploy a heuristic route-recovery algorithm that assigns routes to CAVs and departure/arrival time at each road segment. Furthermore, we propose an efficient coordination method that rapidly solves constrained optimization problems by flexibly piecing together unconstrained energy-optimal trajectories. The proposed method has the potential to effectively generate optimal vehicle flow, contributing to the reduction of travel time and energy consumption in urban areas. △ Less

Submitted 22 November, 2023; originally announced November 2023.

Comments: 17 pages, 11 figures

Stochastic Control with Distributionally Robust Constraints for Cyber-Physical Systems Vulnerable to Attacks

Authors: Nishanth Venkatesh, Aditya Dave, Ioannis Faros, Andreas A. Malikopoulos

Abstract: In this paper, we investigate the control of a cyber-physical system (CPS) while accounting for its vulnerability to external attacks. We formulate a constrained stochastic problem with a robust constraint to ensure robust operation against potential attacks. We seek to minimize the expected cost subject to a constraint limiting the worst-case expected damage an attacker can impose on the CPS. We… ▽ More In this paper, we investigate the control of a cyber-physical system (CPS) while accounting for its vulnerability to external attacks. We formulate a constrained stochastic problem with a robust constraint to ensure robust operation against potential attacks. We seek to minimize the expected cost subject to a constraint limiting the worst-case expected damage an attacker can impose on the CPS. We present a dynamic programming decomposition to compute the optimal control strategy in this robust-constrained formulation and prove its recursive feasibility. We also illustrate the utility of our results by applying them to a numerical simulation. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Comments: 8 pages, 2 Figures with 3 sub-figures each, submitted to the ECC 2024 conference for review

Journal ref: European Journal of Control, 2024

Stochastic Time-Optimal Trajectory Planning for Connected and Automated Vehicles in Mixed-Traffic Merging Scenarios

Authors: Viet-Anh Le, Behdad Chalaki, Filippos N. Tzortzoglou, Andreas A. Malikopoulos

Abstract: Addressing safe and efficient interaction between connected and automated vehicles (CAVs) and human-driven vehicles in a mixed-traffic environment has attracted considerable attention. In this paper, we develop a framework for stochastic time-optimal trajectory planning for coordinating multiple CAVs in mixed-traffic merging scenarios. We present a data-driven model, combining Newell's car-followi… ▽ More Addressing safe and efficient interaction between connected and automated vehicles (CAVs) and human-driven vehicles in a mixed-traffic environment has attracted considerable attention. In this paper, we develop a framework for stochastic time-optimal trajectory planning for coordinating multiple CAVs in mixed-traffic merging scenarios. We present a data-driven model, combining Newell's car-following model with Bayesian linear regression, for efficiently learning the driving behavior of human drivers online. Using the prediction model and uncertainty quantification, a stochastic time-optimal control problem is formulated to find robust trajectories for CAVs. We also integrate a replanning mechanism that determines when deriving new trajectories for CAVs is needed based on the accuracy of the Bayesian linear regression predictions. Finally, we demonstrate the performance of our proposed framework using a realistic simulation environment. △ Less

Submitted 31 October, 2023; originally announced November 2023.

Comments: first submission 15 pages

A Q-learning Approach for Adherence-Aware Recommendations

Authors: Ioannis Faros, Aditya Dave, Andreas A. Malikopoulos

Abstract: In many real-world scenarios involving high-stakes and safety implications, a human decision-maker (HDM) may receive recommendations from an artificial intelligence while holding the ultimate responsibility of making decisions. In this letter, we develop an "adherence-aware Q-learning" algorithm to address this problem. The algorithm learns the "adherence level" that captures the frequency with wh… ▽ More In many real-world scenarios involving high-stakes and safety implications, a human decision-maker (HDM) may receive recommendations from an artificial intelligence while holding the ultimate responsibility of making decisions. In this letter, we develop an "adherence-aware Q-learning" algorithm to address this problem. The algorithm learns the "adherence level" that captures the frequency with which an HDM follows the recommended actions and derives the best recommendation policy in real time. We prove the convergence of the proposed Q-learning algorithm to the optimal value and evaluate its performance across various scenarios. △ Less

Submitted 12 September, 2023; originally announced September 2023.

Journal ref: IEEE Control Systems Letters (L-CSS), Vol 7, 2023

Routing in Mixed Transportation Systems for Mobility Equity

Authors: Heeseung Bang, Aditya Dave, Andreas A. Malikopoulos

Abstract: This letter proposes a routing framework in mixed transportation systems for improving mobility equity. We present a strategic routing game that governs interactions between compliant and noncompliant vehicles, where noncompliant vehicles are modeled with cognitive hierarchy theory. Then, we introduce a mobility equity metric (MEM) to quantify the accessibility and fairness in the transportation n… ▽ More This letter proposes a routing framework in mixed transportation systems for improving mobility equity. We present a strategic routing game that governs interactions between compliant and noncompliant vehicles, where noncompliant vehicles are modeled with cognitive hierarchy theory. Then, we introduce a mobility equity metric (MEM) to quantify the accessibility and fairness in the transportation network. We integrate the MEM into the routing framework to optimize it with adjustable weights for different transportation modes. The proposed approach bridges the gap between technological advancements and societal goals in mixed transportation systems to enhance efficiency and equity. We provide numerical examples and analysis of the results. △ Less

Submitted 7 September, 2023; originally announced September 2023.

Comments: 6 pages, 5 figures

Journal ref: Proceedings of 2024 American Control Conference (ACC), Toronto, Canada, 2024

Performance-Sensitive Potential Functions for Efficient Flow of Connected and Automated Vehicles

Authors: Filippos N. Tzortzoglou, Dionysios Theodosis, Aditya Dave, Andreas Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. In this paper, we address the problem of effectively coordinating CAVs on lane-based roadways. Our approach utilizes potential functions to generate repulsive forces between CAVs… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. In this paper, we address the problem of effectively coordinating CAVs on lane-based roadways. Our approach utilizes potential functions to generate repulsive forces between CAVs that ensure collision avoidance. However, such potential functions can lead to unrealistic acceleration profiles and large inter-vehicle distances. The primary contribution of this work is the introduction of performance-sensitive potential functions to address these challenges. In our approach, the parameters of a potential function are determined through an optimization problem aiming to reduce both acceleration and inter-vehicle distances. To circumvent the computational implications due to the complexity of the resulting optimization problem that prevents the derivation of a real-time solution, we train a neural network model to learn the mapping of initial conditions to optimal parameters derived offline. Then, we prove sufficient criteria for the sampled-data model to ensure that the neural network output does not activate any of the state and safety constraints. Finally, we provide simulation results to demonstrate the effectiveness of the proposed approach. △ Less

Submitted 3 September, 2023; originally announced September 2023.

Journal ref: 2024 American Control Conference (ACC)

An Approach for Optimizing Acceleration in Connected and Automated Vehicles

Authors: Filippos N. Tzortzoglou, Dionysios Theodosis, Andreas Malikopoulos

Abstract: Vehicle automation technology has made significant progress, laying the groundwork for a future of fully automated vehicles. This paper delves into the operation of connected and automated vehicles (CAVs). In prior work, we developed a controller that includes a tunable gain whose value significantly influences CAV performance and, in particular, its acceleration. By varying this gain, CAV acceler… ▽ More Vehicle automation technology has made significant progress, laying the groundwork for a future of fully automated vehicles. This paper delves into the operation of connected and automated vehicles (CAVs). In prior work, we developed a controller that includes a tunable gain whose value significantly influences CAV performance and, in particular, its acceleration. By varying this gain, CAV acceleration is associated with different values depending on some initial conditions. Thus, our goal in this paper is to identify the optimal value of this gain in terms of acceleration for any group of initial conditions. To this end, we formulate an optimization problem where the decision variable is the gain value, and the objective function includes the acceleration of the vehicles. The complexity of this problem prohibits real-time solutions. To address this challenge, we train a neural network to map different initial conditions to the optimal gain values efficiently. We showcase the proposed approach to deriving the optimal gains in a merging scenario with an on-ramp. △ Less

Submitted 8 August, 2023; originally announced August 2023.

Coordination for Connected Automated Vehicles at Merging Roadways in Mixed Traffic Environment

Authors: Viet-Anh Le, Hao M. Wang, Gabor Orosz, Andreas A. Malikopoulos

Abstract: In this paper, we present an optimal control framework to address motion coordination of connected automated vehicles (CAVs) in the presence of human-driven vehicles (HDVs) in merging scenarios. Our framework combines an unconstrained trajectory solution of a low-level energy-optimal control problem with an upper-level optimization problem that yields the minimum travel time for CAVs. We predict t… ▽ More In this paper, we present an optimal control framework to address motion coordination of connected automated vehicles (CAVs) in the presence of human-driven vehicles (HDVs) in merging scenarios. Our framework combines an unconstrained trajectory solution of a low-level energy-optimal control problem with an upper-level optimization problem that yields the minimum travel time for CAVs. We predict the future trajectories of the HDVs using Newell's car-following model. To handle potential deviations of HDVs' actual behavior from the predicted one, we design a safety filter for CAVs based on control barrier functions. The effectiveness of the proposed control framework is demonstrated via simulations with heterogeneous human driving behaviors. △ Less

Submitted 6 September, 2023; v1 submitted 11 April, 2023; originally announced April 2023.

Comments: final CDC manuscript, 6 pages

Connected and Automated Vehicles in Mixed-Traffic: Learning Human Driver Behavior for Effective On-Ramp Merging

Authors: Nishanth Venkatesh, Viet-Anh Le, Aditya Dave, Andreas A. Malikopoulos

Abstract: Highway merging scenarios featuring mixed traffic conditions pose significant modeling and control challenges for connected and automated vehicles (CAVs) interacting with incoming on-ramp human-driven vehicles (HDVs). In this paper, we present an approach to learn an approximate information state model of CAV-HDV interactions for a CAV to maneuver safely during highway merging. In our approach, th… ▽ More Highway merging scenarios featuring mixed traffic conditions pose significant modeling and control challenges for connected and automated vehicles (CAVs) interacting with incoming on-ramp human-driven vehicles (HDVs). In this paper, we present an approach to learn an approximate information state model of CAV-HDV interactions for a CAV to maneuver safely during highway merging. In our approach, the CAV learns the behavior of an incoming HDV using approximate information states before generating a control strategy to facilitate merging. First, we validate the efficacy of this framework on real-world data by using it to predict the behavior of an HDV in mixed traffic situations extracted from the Next-Generation Simulation repository. Then, we generate simulation data for HDV-CAV interactions in a highway merging scenario using a standard inverse reinforcement learning approach. Without assuming a prior knowledge of the generating model, we show that our approximate information state model learns to predict the future trajectory of the HDV using only observations. Subsequently, we generate safe control policies for a CAV while merging with HDVs, demonstrating a spectrum of driving behaviors, from aggressive to conservative. We demonstrate the effectiveness of the proposed approach by performing numerical simulations. △ Less

Submitted 1 April, 2023; originally announced April 2023.

A Study of an Atomic Mobility Game With Uncertainty Under Prospect Theory

Authors: Ioannis Vasileios Chremos, Heeseung Bang, Aditya Dave, Viet-Anh Le, Andreas A. Malikopoulos

Abstract: In this paper, we present a study of a mobility game with uncertainty in the decision-making of travelers and incorporate prospect theory to model travel behavior. We formulate a mobility game that models how travelers distribute their traffic flows in a transportation network with splittable traffic, utilizing the Bureau of Public Roads function to establish the relationship between traffic flow… ▽ More In this paper, we present a study of a mobility game with uncertainty in the decision-making of travelers and incorporate prospect theory to model travel behavior. We formulate a mobility game that models how travelers distribute their traffic flows in a transportation network with splittable traffic, utilizing the Bureau of Public Roads function to establish the relationship between traffic flow and travel time cost. Given the inherent non-linearities and complexity introduced by the uncertainties, we propose a smooth approximation function to estimate the prospect-theoretic cost functions. As part of our analysis, we characterize the best-fit parameters and derive an upper bound for the error. We then show the existence of an equilibrium and its its best-possible approximation. △ Less

Submitted 18 March, 2024; v1 submitted 30 March, 2023; originally announced March 2023.

Comments: arXiv admin note: text overlap with arXiv:2202.07691

A Hierarchical Approach to Optimal Flow-Based Routing and Coordination of Connected and Automated Vehicles

Authors: Heeseung Bang, Andreas A. Malikopoulos

Abstract: This paper addresses the challenge of generating optimal vehicle flow at the macroscopic level. Although several studies have focused on optimizing vehicle flow, little attention has been given to ensuring it can be practically achieved. To overcome this issue, we propose a route-recovery and eco-driving strategy for connected and automated vehicles (CAVs) that guarantees optimal flow generation.… ▽ More This paper addresses the challenge of generating optimal vehicle flow at the macroscopic level. Although several studies have focused on optimizing vehicle flow, little attention has been given to ensuring it can be practically achieved. To overcome this issue, we propose a route-recovery and eco-driving strategy for connected and automated vehicles (CAVs) that guarantees optimal flow generation. Our approach involves identifying the optimal vehicle flow that minimizes total travel time, given the constant travel demands in urban areas. We then develop a heuristic route-recovery algorithm to assign routes to CAVs. Finally, we present an efficient coordination framework to minimize the energy consumption of CAVs while safely crossing intersections. The proposed method can effectively generate optimal vehicle flow and potentially reduce travel time and energy consumption in urban areas. △ Less

Submitted 6 September, 2023; v1 submitted 30 March, 2023; originally announced March 2023.

Comments: 6 pages, 5 figures

Worst-Case Control and Learning Using Partial Observations Over an Infinite Time-Horizon

Authors: Aditya Dave, Ioannis Faros, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning in partially observed systems to minimize the worst-case discounted cost over an infinite time horizon. We model disturbances to the system as finite-valued un… ▽ More Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning in partially observed systems to minimize the worst-case discounted cost over an infinite time horizon. We model disturbances to the system as finite-valued uncertain variables with unknown probability distributions. For problems with known system dynamics, we construct a dynamic programming (DP) decomposition to compute the optimal control strategy. Our first contribution is to define information states that improve the computational tractability of this DP without loss of optimality. Then, we describe a simplification for a class of problems where the incurred cost is observable at each time instance. Our second contribution is defining an approximate information state that can be constructed or learned directly from observed data for problems with observable costs. We derive bounds on the performance loss of the resulting approximate control strategy and illustrate the effectiveness of our approach in partially observed decision-making problems with a numerical example. △ Less

Submitted 31 March, 2023; v1 submitted 28 March, 2023; originally announced March 2023.

On Safety of Passengers Entering a Bus Rapid Transit System from Scheduled Stops

Authors: Alejandra Valencia, Andreas A. Malikopoulos

Abstract: In this paper, we address the vehicle scheduling problem for improving passenger safety in bus rapid transit systems. Our focus is on passengers waiting at street stops to enter terminal stations. To enhance their safety, we minimize deviations from the proposed timetable, thereby minimizing passengers' initial waiting time. We formulate an optimization problem considering the position, speed devi… ▽ More In this paper, we address the vehicle scheduling problem for improving passenger safety in bus rapid transit systems. Our focus is on passengers waiting at street stops to enter terminal stations. To enhance their safety, we minimize deviations from the proposed timetable, thereby minimizing passengers' initial waiting time. We formulate an optimization problem considering the position, speed deviation, and passenger count at each stop, solved using dynamic programming. Numerical simulations validate the effectiveness of our approach in enhancing passenger safety. Our work is the first attempt to minimize waiting time for improved safety and the first to utilize position tracking for departure time matching. △ Less

Submitted 2 June, 2023; v1 submitted 10 February, 2023; originally announced February 2023.

Comments: 6 pages, 5 figures, 7th IEEE Conference on Control Technology and Applications (CCTA) 2023

Approximate Information States for Worst-Case Control and Learning in Uncertain Systems

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we investigate discrete-time decision-making problems in uncertain systems with partially observed states. We consider a non-stochastic model, where uncontrolled disturbances acting on the system take values in bounded sets with unknown distributions. We present a general framework for decision-making in such problems by using the notion of the information state and approximate info… ▽ More In this paper, we investigate discrete-time decision-making problems in uncertain systems with partially observed states. We consider a non-stochastic model, where uncontrolled disturbances acting on the system take values in bounded sets with unknown distributions. We present a general framework for decision-making in such problems by using the notion of the information state and approximate information state, and introduce conditions to identify an uncertain variable that can be used to compute an optimal strategy through a dynamic program (DP). Next, we relax these conditions and define approximate information states that can be learned from output data without knowledge of system dynamics. We use approximate information states to formulate a DP that yields a strategy with a bounded performance loss. Finally, we illustrate the application of our results in control and reinforcement learning using numerical examples. △ Less

Submitted 5 April, 2024; v1 submitted 12 January, 2023; originally announced January 2023.

Comments: Preliminary results related to this article were reported in arXiv:2203.15271

Journal ref: IEEE Transactions on Automatic Control (TAC), 2024

Mechanism Design Theory in Control Engineering: A Tutorial and Overview of Applications in Communication, Power Grid, Transportation, and Security Systems

Authors: Ioannis Vasileios Chremos, Andreas A. Malikopoulos

Abstract: This article provides an introduction to the theory of mechanism design and its application to engineering problems. Our aim is to provide the fundamental principles of the theory of mechanism design for control engineers and theorists along with the state-of-the-art methods in engineering applications. We start our exposition with a brief overview of game theory highlighting the key notions that… ▽ More This article provides an introduction to the theory of mechanism design and its application to engineering problems. Our aim is to provide the fundamental principles of the theory of mechanism design for control engineers and theorists along with the state-of-the-art methods in engineering applications. We start our exposition with a brief overview of game theory highlighting the key notions that are necessary to introduce mechanism design, and then we offer a comprehensive discussion of the principles in mechanism design. Finally, we explore four key applications of mechanism design in engineering, i.e., communication networks, power grids, transportation, and security systems. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Report number: Volume: 44, Issue: 1

Journal ref: IEEE Control Systems Magazine 2024

Optimal Weight Adaptation of Model Predictive Control for Connected and Automated Vehicles in Mixed Traffic with Bayesian Optimization

Authors: Viet-Anh Le, Andreas A. Malikopoulos

Abstract: In this paper, we develop an optimal weight adaptation strategy of model predictive control (MPC) for connected and automated vehicles (CAVs) in mixed traffic. We model the interaction between a CAV and a human-driven vehicle (HDV) as a simultaneous game and formulate a game-theoretic MPC problem to find a Nash equilibrium of the game. In the MPC problem, the weights in the HDV's objective functio… ▽ More In this paper, we develop an optimal weight adaptation strategy of model predictive control (MPC) for connected and automated vehicles (CAVs) in mixed traffic. We model the interaction between a CAV and a human-driven vehicle (HDV) as a simultaneous game and formulate a game-theoretic MPC problem to find a Nash equilibrium of the game. In the MPC problem, the weights in the HDV's objective function can be learned online using moving horizon inverse reinforcement learning. Using Bayesian optimization, we propose a strategy to optimally adapt the weights in the CAV's objective function so that the expected true cost when using MPC in simulations can be minimized. We validate the effectiveness of the optimal strategy by numerical simulations of a vehicle crossing example at an unsignalized intersection. △ Less

Submitted 10 March, 2023; v1 submitted 2 October, 2022; originally announced October 2022.

Comments: accepted to ACC 2023

Re-Routing Strategy of Connected and Automated Vehicles Considering Coordination at Intersections

Authors: Heeseung Bang, Andreas A. Malikopoulos

Abstract: In this paper, we propose a re-routing strategy for connected and automated vehicles (CAVs), considering coordination and control of all the CAVs in the network. The objective for each CAV is to find the route that minimizes the total travel time of all CAVs. We coordinate CAVs at signal-free intersections to accurately predict the travel time for the routing problem. While it is possible to find… ▽ More In this paper, we propose a re-routing strategy for connected and automated vehicles (CAVs), considering coordination and control of all the CAVs in the network. The objective for each CAV is to find the route that minimizes the total travel time of all CAVs. We coordinate CAVs at signal-free intersections to accurately predict the travel time for the routing problem. While it is possible to find a system-optimal solution by comparing all the possible combinations of the routes, this may impose a computational burden. Thus, we instead find a person-by-person optimal solution to reduce computational time while still deriving a better solution than selfish routing. We validate our framework through simulations in a grid network. △ Less

Submitted 19 February, 2023; v1 submitted 1 October, 2022; originally announced October 2022.

Comments: 6 pages, 4 figures

A Constraint-Driven Approach to Line Flocking: The V Formation as an Energy-Saving Strategy

Authors: Logan E. Beaver, Christopher Kroninger, Michael Dorothy, Andreas A. Malikopoulos

Abstract: The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents… ▽ More The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents to the system. First, we present an analytical model for the trailing upwash behind a fixed-wing UAV, and we derive the optimal air speed for trailing UAVs to maximize their travel endurance. Next, we prove that simply flying at the optimal airspeed will never lead to emergent flocking behavior, and we propose a new decentralized "anseroid" behavior that yields emergent V formations. We encode these behaviors in a constraint-driven control algorithm that minimizes the locomotive power of each UAV. Finally, we prove that UAVs initialized in an approximate V or echelon formation will converge under our proposed control law, and we demonstrate this emergence occurs in real-time in simulation and in physical experiments with a fleet of Crazyflie quadrotors. △ Less

Submitted 23 September, 2022; originally announced September 2022.

Comments: 12 pages, 7 figures

A Cooperative Optimal Control Framework for Connected and Automated Vehicles in Mixed Traffic Using Social Value Orientation

Authors: Viet-Anh Le, Andreas A. Malikopoulos

Abstract: In this paper, we develop a socially cooperative optimal control framework to address the motion planning problem for connected and automated vehicles (CAVs) in mixed traffic using social value orientation (SVO) and a potential game approach. In the proposed framework, we formulate the interaction between a CAV and a human-driven vehicle (HDV) as a simultaneous game where each vehicle minimizes a… ▽ More In this paper, we develop a socially cooperative optimal control framework to address the motion planning problem for connected and automated vehicles (CAVs) in mixed traffic using social value orientation (SVO) and a potential game approach. In the proposed framework, we formulate the interaction between a CAV and a human-driven vehicle (HDV) as a simultaneous game where each vehicle minimizes a weighted sum of its egoistic objective and a cooperative objective. The SVO angles are used to quantify preferences of the vehicles toward the egoistic and cooperative objectives. Using the potential game approach, we propose a single objective function for the optimal control problem whose weighting factors are chosen based on the SVOs of the vehicles. We prove that a Nash equilibrium can be obtained by minimizing the proposed objective function. To estimate the SVO angle of the HDV, we develop a moving horizon estimation algorithm based on maximum entropy inverse reinforcement learning. The effectiveness of the proposed approach is demonstrated by numerical simulations of a vehicle merging scenario. △ Less

Submitted 10 September, 2022; v1 submitted 31 March, 2022; originally announced March 2022.

Comments: final version to CDC2022

A Barrier-Certified Optimal Coordination Framework for Connected and Automated Vehicles

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection by integrating a safety layer using control barrier functions. First, in our motion planning module, each CAV computes the optimal control trajectory using simple vehicle dynamics. The trajectory does not make any of the state, control, and safety… ▽ More In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection by integrating a safety layer using control barrier functions. First, in our motion planning module, each CAV computes the optimal control trajectory using simple vehicle dynamics. The trajectory does not make any of the state, control, and safety constraints active. A vehicle-level tracking controller employs a combined feedforward-feedback control law to track the resulting optimal trajectory from the motion planning module. Then, a barrier-certificate module, acting as a middle layer between the vehicle-level tracking controller and physical vehicle, receives the control law from the vehicle-level tracking controller and using realistic vehicle dynamics ensures that none of the state, control, and safety constraints becomes active. The latter is achieved through a quadratic program, which can be solved efficiently in real time. We demonstrate the effectiveness of our extended framework through a numerical simulation. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: 8 pages, 5 figures, 1 table

Journal ref: IEEE Conference on Decision and Control, (2022), 2264-2269

Mobility Equity and Economic Sustainability Using Game Theory

Authors: Ioannis Vasileios Chremos, Andreas Malikopoulos

Abstract: In this paper, we consider a multi-modal mobility system of travelers each with an individual travel budget, and propose a game-theoretic framework to assign each traveler to a ``mobility service" (each one representing a different mode of transportation). We are interested in equity and sustainability, thus we maximize the worst-case revenue of the mobility system while ensuring ``mobility equity… ▽ More In this paper, we consider a multi-modal mobility system of travelers each with an individual travel budget, and propose a game-theoretic framework to assign each traveler to a ``mobility service" (each one representing a different mode of transportation). We are interested in equity and sustainability, thus we maximize the worst-case revenue of the mobility system while ensuring ``mobility equity," which we define it in terms of accessibility. In the proposed framework, we ensure that all travelers are truthful and voluntarily participate under informational asymmetry, and the solution respects the individual budget of each traveler. Each traveler may seek to travel using multiple services (e.g., car, bus, train, bike). The services are capacitated and can serve up to a fixed number of travelers at any instant of time. Thus, our problem falls under the category of many-to-one assignment problems, where the goal is to find the conditions that guarantee the stability of assignments. We formulate a linear program of maximizing worst-case revenue under the constraints of mobility equity, and we fully characterize the optimal solution. △ Less

Submitted 26 February, 2023; v1 submitted 21 March, 2022; originally announced March 2022.

Comments: arXiv admin note: text overlap with arXiv:2110.06403

Combined Optimal Routing and Coordination of Connected and Automated Vehicles

Authors: Heeseung Bang, Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this letter, we consider a transportation network with a 100\% penetration rate of connected and automated vehicles (CAVs) and present an optimal routing approach that takes into account the efficiency achieved in the network by coordinating the CAVs at specific traffic scenarios, e.g., intersections, merging roadways, and roundabouts. To derive the optimal route of a travel request, we use the… ▽ More In this letter, we consider a transportation network with a 100\% penetration rate of connected and automated vehicles (CAVs) and present an optimal routing approach that takes into account the efficiency achieved in the network by coordinating the CAVs at specific traffic scenarios, e.g., intersections, merging roadways, and roundabouts. To derive the optimal route of a travel request, we use the information of the CAVs that have already received a routing solution. This enables each CAV to consider the traffic conditions on the roads. The solution of any new travel request determines the optimal travel time at each traffic scenario while satisfying all state, control, and safety constraints. We validate the performance of our framework through numerical simulations. To the best of our knowledge, this is the first attempt to consider the coordination of CAVs in a routing problem. △ Less

Submitted 17 May, 2022; v1 submitted 21 March, 2022; originally announced March 2022.

Comments: 6 pages, 5 figures

Journal ref: IEEE Control Systems Letters, 2022

Performance Analysis of Optimally Coordinated Connected and Automated Vehicles in a Mixed Traffic Environment

Authors: Alejandra Valencia, A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Trajectory planning of connected and automated vehicles (CAVs) poses significant challenges in a mixed traffic environment due to the presence of human-driven vehicles (HDVs). In this paper, we apply a framework that allows coordination of CAVs and HDVs traveling through a traffic corridor consisting of an on-ramp merging, a speed reduction zone, and a roundabout. We study the impact of different… ▽ More Trajectory planning of connected and automated vehicles (CAVs) poses significant challenges in a mixed traffic environment due to the presence of human-driven vehicles (HDVs). In this paper, we apply a framework that allows coordination of CAVs and HDVs traveling through a traffic corridor consisting of an on-ramp merging, a speed reduction zone, and a roundabout. We study the impact of different penetration rates of CAVs and traffic volumes on the efficiency of the corridor. We provide extensive simulation results and report on the benefits in terms of total travel time and fuel economy. △ Less

Submitted 20 June, 2022; v1 submitted 20 February, 2022; originally announced February 2022.

Comments: 6 pages conference

The Design and Analysis of a Mobility Game

Authors: Ioannis Vasileios Chremos, Andreas A. Malikopoulos

Abstract: In this paper, we study a routing and travel-mode choice problem for mobility systems with a multimodal transportation network as a ``mobility game" with coupled action sets. We develop a game-theoretic framework to study the impact on efficiency of the travelers' behavioral decision-making. In our framework, we introduce a mobility ``pricing mechanism," in which we model traffic congestion using… ▽ More In this paper, we study a routing and travel-mode choice problem for mobility systems with a multimodal transportation network as a ``mobility game" with coupled action sets. We develop a game-theoretic framework to study the impact on efficiency of the travelers' behavioral decision-making. In our framework, we introduce a mobility ``pricing mechanism," in which we model traffic congestion using linear cost functions while also considering the waiting times at different transport hubs. We show that the travelers' selfish actions lead to a pure-strategy Nash equilibrium. We then perform a Price of Anarchy analysis to establish that the mobility system's inefficiencies remain relatively low as the number of travelers increases. We deviate from the standard game-theoretic analysis of decision-making by extending our modeling framework to capture the subjective behavior of travelers using prospect theory. Finally, we provide a simulation study as a proof of concept for our proposed mobility game. △ Less

Submitted 14 December, 2022; v1 submitted 15 February, 2022; originally announced February 2022.

An Analytical Study of a Two-Sided Mobility Game

Authors: Ioannis Vasileios Chremos, Andreas Malikopoulos

Abstract: In this paper, we consider a mobility system of travelers and providers, and propose a "mobility game" to study when a traveler is matched to a provider. Each traveler seeks to travel using the services of only one provider, who manages one specific mode of transportation (e.g., car, bus, train, bike). The services of each provider are capacitated and can serve up to a fixed number of travelers at… ▽ More In this paper, we consider a mobility system of travelers and providers, and propose a "mobility game" to study when a traveler is matched to a provider. Each traveler seeks to travel using the services of only one provider, who manages one specific mode of transportation (e.g., car, bus, train, bike). The services of each provider are capacitated and can serve up to a fixed number of travelers at any instant of time. Thus, our problem falls under the category of many-to-one assignment problems, where the goal is to find the conditions that guarantee the stability of assignments. We formulate a linear program of maximizing the social welfare of travelers and providers and show how it is equivalent to the original problem and relate its solutions to stable assignments. We also investigate our results under informational asymmetry and provide a "mechanism" that elicits the information of travelers and providers. Finally, we investigate and validate the advantages of our method by providing a numerical simulation example. △ Less

Submitted 12 March, 2022; v1 submitted 12 October, 2021; originally announced October 2021.

Report number: 2022 American Control Conference (ACC), pp. 1254--1259

A Multi-Agent Deep Reinforcement Learning Coordination Framework for Connected and Automated Vehicles at Merging Roadways

Authors: Sai Krishna Sumanth Nakka, Behdad Chalaki, Andreas Malikopoulos

Abstract: The steady increase in the number of vehicles operating on the highways continues to exacerbate congestion, accidents, energy consumption, and greenhouse gas emissions. Emerging mobility systems, e.g., connected and automated vehicles (CAVs), have the potential to directly address these issues and improve transportation network efficiency and safety. In this paper, we consider a highway merging sc… ▽ More The steady increase in the number of vehicles operating on the highways continues to exacerbate congestion, accidents, energy consumption, and greenhouse gas emissions. Emerging mobility systems, e.g., connected and automated vehicles (CAVs), have the potential to directly address these issues and improve transportation network efficiency and safety. In this paper, we consider a highway merging scenario and propose a framework for coordinating CAVs such that stop-and-go driving is eliminated. We use a decentralized form of the actor-critic approach to deep reinforcement learning$-$multi-agent deep deterministic policy gradient. We demonstrate the coordination of CAVs through numerical simulations and show that a smooth traffic flow is achieved by eliminating stop-and-go driving. Videos and plots of the simulation results can be found at this supplemental $\href{https://sites.google.com/view/ud-ids-lab/MADRL}{\text{site}}$. △ Less

Submitted 13 March, 2022; v1 submitted 23 September, 2021; originally announced September 2021.

Comments: 6 pages, 6 figures

ACM Class: I.2.1; I.2.4; I.2.6; I.2.10; I.2.11; I.6.5

Journal ref: 2022 American Control Conference (ACC), (2022), 3297-3302

A Priority-Aware Replanning and Resequencing Framework for Coordination of Connected and Automated Vehicles

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: Deriving optimal control strategies for coordination of connected and automated vehicles (CAVs) often requires re-evaluating the strategies in order to respond to unexpected changes in the presence of disturbances and uncertainties. In this paper, we first extend a decentralized framework that we developed earlier for coordination of CAVs at a signal-free intersection to incorporate replanning. Th… ▽ More Deriving optimal control strategies for coordination of connected and automated vehicles (CAVs) often requires re-evaluating the strategies in order to respond to unexpected changes in the presence of disturbances and uncertainties. In this paper, we first extend a decentralized framework that we developed earlier for coordination of CAVs at a signal-free intersection to incorporate replanning. Then, we further enhance the framework by introducing a priority-aware resequencing mechanism which designates the order of decision making of CAVs based on theory from the job-shop scheduling problem. Our enhanced framework relaxes the first-come-first-serve decision order which has been used extensively in these problems. We illustrate the effectiveness of our proposed approach through numerical simulations. △ Less

Submitted 9 December, 2021; v1 submitted 12 September, 2021; originally announced September 2021.

Comments: 6 pages, 4 figures

Journal ref: IEEE Control Systems Letters (2022) 1772-1777

Optimal Control of Differentially Flat Systems is Surprisingly Easy

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise… ▽ More As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise during optimization, and this simplification eliminates the numerical instabilities that plague optimal control in general. We also present an explicit differential equation that describes the evolution of the optimal state trajectory, and we extend our results to consider both the unconstrained and constrained cases. Furthermore, we demonstrate the performance of our approach by generating the optimal trajectory for a planar manipulator with two revolute joints. We show in simulation that our approach is able to generate the constrained optimal trajectory in $4.5$ ms while respecting workspace constraints and switching between a `left' and `right' bend in the elbow joint. △ Less

Submitted 26 August, 2023; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: 14 pages, 4 figures

Socioeconomic Impact of Emerging Mobility Markets and Implementation Strategies

Authors: Ioannis Vasileios Chremos, Andreas A. Malikopoulos

Abstract: Emerging mobility systems such as connected and automated vehicles (CAVs) provide the most intriguing opportunity for more accessible, safe, and efficient transportation. CAVs are expected to significantly improve safety by eliminating the human factor and ensure transportation efficiency by allowing users to monitor transportation network conditions and make better operating decisions. However, C… ▽ More Emerging mobility systems such as connected and automated vehicles (CAVs) provide the most intriguing opportunity for more accessible, safe, and efficient transportation. CAVs are expected to significantly improve safety by eliminating the human factor and ensure transportation efficiency by allowing users to monitor transportation network conditions and make better operating decisions. However, CAVs could alter the users' tendency-to-travel, leading to a higher traffic demand than expected, thus causing rebound effects (e.g., increased vehicle-miles-traveled). In this chapter, we focus on tackling social factors that could drive an emerging mobility system to unsustainable congestion levels. We propose a mobility market that models the economic in-nature interactions of the travelers in a smart city network with roads and public transit infrastructure. Using techniques from mechanism design, we introduce appropriate monetary incentives (e.g., tolls, fares, fees) and show how a mobility system consisting of selfish travelers that seek to travel either with a CAV or use public transit can be socially efficient. Furthermore, the proposed mobility market ensures that travelers always report their true travel preferences and always benefit from participating in the market; lastly, we also show that the market generates enough revenue to potentially cover its operating costs. △ Less

Submitted 19 October, 2021; v1 submitted 29 November, 2020; originally announced November 2020.

Design and Stability Analysis of a Shared Mobility Market

Authors: Ioannis Vasileios Chremos, Andreas Malikopoulos

Abstract: In recent years, we have witnessed a remarkable surge of usage in shared vehicles in our cities. Shared mobility offers a future of no congestion in busy city roads with increasing populations of travelers, passengers, and drivers. Given the behavioral decision-making of travelers and the shared vehicles' operators, however, the question is "how can we ensure a socially-acceptable assignment betwe… ▽ More In recent years, we have witnessed a remarkable surge of usage in shared vehicles in our cities. Shared mobility offers a future of no congestion in busy city roads with increasing populations of travelers, passengers, and drivers. Given the behavioral decision-making of travelers and the shared vehicles' operators, however, the question is "how can we ensure a socially-acceptable assignment between travelers and vehicles?" In other words, how can we design a shared mobility system that assigns each traveler to the "right" vehicle? In this paper, we design a shared mobility market consisted of travelers and vehicles in a transportation network. We formulate a linear programming problem and derive the optimal assignment between travelers and vehicles. In addition, we provide the necessary and sufficient conditions for the stable traveler-vehicle profit allocation. Our goal is twofold: maximize the social welfare of all travelers with the optimal assignment while ensuring the feasibility and stability of the traveler-vehicle profit allocation while respecting the decision-making of both the travelers and the vehicles' operators. △ Less

Submitted 17 November, 2020; originally announced November 2020.

A Hysteretic Q-learning Coordination Framework for Emerging Mobility Systems in Smart Cities

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) can alleviate traffic congestion, air pollution, and improve safety. In this paper, we provide a decentralized coordination framework for CAVs at a signal-free intersection to minimize travel time and improve fuel efficiency. We employ a simple yet powerful reinforcement learning approach, an off-policy temporal difference learning called Q-learning, enhance… ▽ More Connected and automated vehicles (CAVs) can alleviate traffic congestion, air pollution, and improve safety. In this paper, we provide a decentralized coordination framework for CAVs at a signal-free intersection to minimize travel time and improve fuel efficiency. We employ a simple yet powerful reinforcement learning approach, an off-policy temporal difference learning called Q-learning, enhanced with a coordination mechanism to address this problem. Then, we integrate a first-in-first-out queuing policy to improve the performance of our system. We demonstrate the efficacy of our proposed approach through simulation and comparison with the classical optimal control method based on Pontryagin's minimum principle. △ Less

Submitted 5 November, 2020; originally announced November 2020.

Comments: 8 pages, 5 figures, 2 tables

Journal ref: 2021 European Control Conference (ECC), 17-22

Optimal Control of Connected and Automated Vehicles at Multiple Adjacent Intersections

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we establish a decentralized optimal control framework for connected and automated vehicles (CAVs) crossing multiple adjacent, multi-lane signal-free intersections to minimize energy consumption and improve traffic throughput. Our framework consists of two layers of planning. In the upper-level planning, each CAV computes its optimal arrival time at each intersection recursively alo… ▽ More In this paper, we establish a decentralized optimal control framework for connected and automated vehicles (CAVs) crossing multiple adjacent, multi-lane signal-free intersections to minimize energy consumption and improve traffic throughput. Our framework consists of two layers of planning. In the upper-level planning, each CAV computes its optimal arrival time at each intersection recursively along with the optimal lane to improve the traffic throughput. In the low-level planning, we formulate an energy-optimal control problem with interior-point constraints, the solution of which yields the optimal control input (acceleration/deceleration) of each CAV to cross the intersections at the time specified by the upper-level planning. Moreover, we extend the results of the proposed bi-level framework to include a bounded steady-state error in tracking the optimal position of the CAVs. Finally, we demonstrate the effectiveness of the proposed framework through simulation for symmetric and asymmetric intersections and comparison with traditional signalized intersections. △ Less

Submitted 18 May, 2021; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: 14 pages, 9 figures, 5 tables

Journal ref: IEEE Transactions on Control Systems Technology (2022) vol. 30, no. 3, pp. 972-984

Beyond Reynolds: A Constraint-Driven Approach to Cluster Flocking

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: In this paper, we present an original set of flocking rules using an ecologically-inspired paradigm for control of multi-robot systems. We translate these rules into a constraint-driven optimal control problem where the agents minimize energy consumption subject to safety and task constraints. We prove several properties about the feasible space of the optimal control problem and show that velocit… ▽ More In this paper, we present an original set of flocking rules using an ecologically-inspired paradigm for control of multi-robot systems. We translate these rules into a constraint-driven optimal control problem where the agents minimize energy consumption subject to safety and task constraints. We prove several properties about the feasible space of the optimal control problem and show that velocity consensus is an optimal solution. We also motivate the inclusion of slack variables in constraint-driven problems when the global state is only partially observable by each agent. Finally, we analyze the case where the communication topology is fixed and connected, and prove that our proposed flocking rules achieve velocity consensus. △ Less

Submitted 5 May, 2020; v1 submitted 16 March, 2020; originally announced March 2020.

Comments: 6 pages

Journal ref: 2020 59th IEE Conference on Decision and Control (CDC), 2020, pp 208-213

Social Media and Misleading Information in a Democracy: A Mechanism Design Approach

Authors: Aditya Dave, Ioannis Vasileios Chremos, Andreas A. Malikopoulos

Abstract: In this paper, we present a resource allocation mechanism for the problem of incentivizing filtering among a finite number of strategic social media platforms. We consider the presence of a strategic government and private knowledge of how misinformation affects the users of the social media platforms. Our proposed mechanism incentivizes social media platforms to filter misleading information effi… ▽ More In this paper, we present a resource allocation mechanism for the problem of incentivizing filtering among a finite number of strategic social media platforms. We consider the presence of a strategic government and private knowledge of how misinformation affects the users of the social media platforms. Our proposed mechanism incentivizes social media platforms to filter misleading information efficiently, and thus indirectly prevents the spread of fake news. In particular, we design an economically inspired mechanism that strongly implements all generalized Nash equilibria for efficient filtering of misleading information in the induced game. We show that our mechanism is individually rational, budget balanced, while it has at least one equilibrium. Finally, we show that for quasi-concave utilities and constraints, our mechanism admits a generalized Nash equilibrium and implements a Pareto efficient solution. △ Less

Submitted 7 January, 2021; v1 submitted 12 March, 2020; originally announced March 2020.

Journal ref: IEEE Transactions on Automatic Control, Vol. 67, 5, pp. 2633-2639, 2022

Experimental Validation of a Real-Time Optimal Controller for Coordination of CAVs in a Multi-Lane Roundabout

Authors: Behdad Chalaki, Logan E. Beaver, Andreas A. Malikopoulos

Abstract: Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In th… ▽ More Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In this paper, we validate an optimal control framework developed earlier in a multi-lane roundabout scenario using the University of Delaware's scaled smart city (UDSSC). We first provide conditions where the solution is optimal. Then, we demonstrate the feasibility of the solution using experiments at UDSSC, and show that the optimal solution completely eliminates stop-and-go driving while preserving safety. △ Less

Submitted 18 May, 2020; v1 submitted 29 January, 2020; originally announced January 2020.

Comments: 6 Pages, 4 Figures, 1 table

Journal ref: IEEE Intelligent Vehicles Symposium (IV), (2020), 504-509

Concurrent Optimization of Vehicle Dynamics and Powertrain Operation Using Connectivity and Automation

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce energy consumption and travel delays. In this paper, we propose a two-level control architecture for CAVs to optimize (1) the vehicle's speed profile, aimed at minimizing stop-and-go driving, and (2) the powertrain efficiency of the vehicle for the optimal speed profile derived in (1). The proposed hierarchic… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce energy consumption and travel delays. In this paper, we propose a two-level control architecture for CAVs to optimize (1) the vehicle's speed profile, aimed at minimizing stop-and-go driving, and (2) the powertrain efficiency of the vehicle for the optimal speed profile derived in (1). The proposed hierarchical control framework can be implemented onboard the vehicle in real time with minimal computational effort. We evaluate the effectiveness of the efficiency of the proposed architecture through simulation in Mcity using a 100% penetration rate of CAVs. The results show that the proposed approach yields significant benefits in terms of energy efficiency. △ Less

Submitted 24 January, 2020; v1 submitted 8 November, 2019; originally announced November 2019.

Comments: Updating and replacing the old version of arXiv:1911.03475 with the finalized manuscript

A Decentralized Time- and Energy-Optimal Control Framework for Connected Automated Vehicles: From Simulation to Field Test

Authors: A M Ishtiaque Mahbub, Vasanthi Karri, Darshil Parikh, Shyam Jade, Andreas A. Malikopoulos

Abstract: The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control aimed at optimizing energy consumption with associated benefits. In this paper, we implement an optimal control framework, developed previously, in an Audi A3 etron plug-in hybrid electric vehicle, and demonstrate that we can improve the vehicle's efficiency and tr… ▽ More The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control aimed at optimizing energy consumption with associated benefits. In this paper, we implement an optimal control framework, developed previously, in an Audi A3 etron plug-in hybrid electric vehicle, and demonstrate that we can improve the vehicle's efficiency and travel time in a corridor including an on-ramp merging, a speed reduction zone, and a roundabout. Our exposition includes the development, integration, implementation and validation of the proposed framework in (1) simulation, (2) hardware-in-the-loop (HIL) testing, (3) connectivity enabled virtual reality based bench-test, and (4) field test in Mcity. We show that by adopting such inexpensive, yet effective process, we can efficiently integrate and test the controller framework, ensure proper connectivity and data transmission between different modules of the system, and reduce uncertainty. We evaluate the performance and effectiveness of the control framework and observe significant improvement in terms of energy and travel time compared to the baseline scenario. △ Less

Submitted 24 January, 2020; v1 submitted 4 November, 2019; originally announced November 2019.

Social Resource Allocation in a Mobility System with Connected and Automated Vehicles: A Mechanism Design Problem

Authors: Ioannis Vasileios Chremos, Andreas Malikopoulos

Abstract: In this paper, we investigate the social resource allocation in an emerging mobility system consisting of connected and automated vehicles (CAVs) using mechanism design. CAVs provide the most intriguing opportunity for enabling travelers to monitor mobility system conditions efficiently and make better decisions. However, this new reality will influence travelers' tendency-of-travel and might give… ▽ More In this paper, we investigate the social resource allocation in an emerging mobility system consisting of connected and automated vehicles (CAVs) using mechanism design. CAVs provide the most intriguing opportunity for enabling travelers to monitor mobility system conditions efficiently and make better decisions. However, this new reality will influence travelers' tendency-of-travel and might give rise to rebound effects, e.g., increased-vehicle-miles traveled. To tackle this phenomenon, we propose a mechanism design formulation that provides an efficient social resource allocation of travel time for all travelers. Our focus is on the socio-technical aspect of the problem, i.e., by designing appropriate socio-economic incentives, we seek to prevent potential rebound effects. In particular, we propose an economically inspired mechanism to influence the impact of the travelers' decision-making on the well-being of an emerging mobility system. △ Less

Submitted 31 August, 2020; v1 submitted 28 September, 2019; originally announced September 2019.

Journal ref: IEEE Control Systems Magazine 2024

A Game-Theoretic Analysis of the Social Impact of Connected and Automated Vehicles

Authors: Ioannis Vasileios Chremos, Logan Beaver, Andreas Malikopoulos

Abstract: In this paper, we address the much-anticipated deployment of connected and automated vehicles (CAVs) in society by modeling and analyzing the social-mobility dilemma in a game-theoretic approach. We formulate this dilemma as a normal-form game of players making a binary decision: whether to travel with a CAV (CAV travel) or not (non-CAV travel) and by constructing an intuitive payoff function insp… ▽ More In this paper, we address the much-anticipated deployment of connected and automated vehicles (CAVs) in society by modeling and analyzing the social-mobility dilemma in a game-theoretic approach. We formulate this dilemma as a normal-form game of players making a binary decision: whether to travel with a CAV (CAV travel) or not (non-CAV travel) and by constructing an intuitive payoff function inspired by the socially beneficial outcomes of a mobility system consisting of CAVs. We show that the game is equivalent to the Prisoner's dilemma, which implies that the rational collective decision is the opposite of the socially optimum. We present two different solutions to tackle this phenomenon: one with a preference structure and the other with institutional arrangements. In the first approach, we implement a social mechanism that incentivizes players to non-CAV travel and derive a lower bound on the players that ensures an equilibrium of non-CAV travel. In the second approach, we investigate the possibility of players bargaining to create an institution that enforces non-CAV travel and show that as the number of players increases, the incentive ratio of non-CAV travel over CAV travel tends to zero. We conclude by showcasing the last result with a numerical study. △ Less

Submitted 2 June, 2020; v1 submitted 22 September, 2019; originally announced September 2019.

Enhanced Mobility With Connectivity and Automation: A Review of Shared Autonomous Vehicle Systems

Authors: Liuhui Zhao, Andreas A. Malikopoulos

Abstract: Shared mobility can provide access to transportation on a custom basis without vehicle ownership. The advent of connected and automated vehicle technologies can further enhance the potential benefits of shared mobility systems. Although the implications of a system with shared autonomous vehicles have been investigated, the research reported in the literature has exhibited contradictory outcomes.… ▽ More Shared mobility can provide access to transportation on a custom basis without vehicle ownership. The advent of connected and automated vehicle technologies can further enhance the potential benefits of shared mobility systems. Although the implications of a system with shared autonomous vehicles have been investigated, the research reported in the literature has exhibited contradictory outcomes. In this paper, we present a summary of the research efforts in shared autonomous vehicle systems that have been reported in the literature to date and discuss potential future research directions. △ Less

Submitted 14 September, 2020; v1 submitted 29 May, 2019; originally announced May 2019.

Comments: 17 pages, 3 figures, IEEE Intelligent Transportation Systems Magazine, 2020

Zero-Shot Autonomous Vehicle Policy Transfer: From Simulation to Real-World via Adversarial Learning

Authors: Behdad Chalaki, Logan E. Beaver, Ben Remer, Kathy Jang, Eugene Vinitsky, Alexandre M. Bayen, Andreas A. Malikopoulos

Abstract: In this article, we demonstrate a zero-shot transfer of an autonomous driving policy from simulation to University of Delaware's scaled smart city with adversarial multi-agent reinforcement learning, in which an adversary attempts to decrease the net reward by perturbing both the inputs and outputs of the autonomous vehicles during training. We train the autonomous vehicles to coordinate with each… ▽ More In this article, we demonstrate a zero-shot transfer of an autonomous driving policy from simulation to University of Delaware's scaled smart city with adversarial multi-agent reinforcement learning, in which an adversary attempts to decrease the net reward by perturbing both the inputs and outputs of the autonomous vehicles during training. We train the autonomous vehicles to coordinate with each other while crossing a roundabout in the presence of an adversary in simulation. The adversarial policy successfully reproduces the simulated behavior and incidentally outperforms, in terms of travel time, both a human-driving baseline and adversary-free trained policies. Finally, we demonstrate that the addition of adversarial training considerably improves the performance \eat{stability and robustness} of the policies after transfer to the real world compared to Gaussian noise injection. △ Less

Submitted 22 June, 2020; v1 submitted 12 March, 2019; originally announced March 2019.

Comments: 6 pages, 4 figures

Journal ref: IEEE International Conference on Control & Automation, (2020), 35-40

On the Traffic Impacts of Optimally Controlled Connected and Automated Vehicles

Authors: Liuhui Zhao, Andreas A. Malikopoulos, Jackeline Rios-Torres

Abstract: The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control actions aimed at optimizing energy consumption and associated benefits. Several research efforts reported in the literature to date have proposed decentralized control algorithms to coordinate CAVs in various traffic scenarios, e.g., highway on-ramps, intersections… ▽ More The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control actions aimed at optimizing energy consumption and associated benefits. Several research efforts reported in the literature to date have proposed decentralized control algorithms to coordinate CAVs in various traffic scenarios, e.g., highway on-ramps, intersections, and roundabouts. However, the impact of optimally coordinating CAVs on the performance of a transportation network has not been thoroughly analyzed yet. In this paper, we apply a decentralized optimal control framework in a transportation network and compare its performance to a baseline scenario consisting of human-driven vehicles. We show that introducing of CAVs yields radically improved roadway capacity and network performance. △ Less

Submitted 24 May, 2019; v1 submitted 7 March, 2019; originally announced March 2019.

Comments: 6 pages, 4 figures, 1 table, conference

Optimal Vehicle Dynamics and Powertrain Control for Connected and Automated Vehicles

Authors: Liuhui Zhao, A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: The implementation of connected and automated vehicle technologies enables opportunities for a novel computational framework for real-time control actions aimed at optimizing energy consumption and associated benefits. In this paper, we present a two-level control architecture for a connected and automated plug-in hybrid electric vehicle to optimize simultaneously its speed profile and powertrain… ▽ More The implementation of connected and automated vehicle technologies enables opportunities for a novel computational framework for real-time control actions aimed at optimizing energy consumption and associated benefits. In this paper, we present a two-level control architecture for a connected and automated plug-in hybrid electric vehicle to optimize simultaneously its speed profile and powertrain efficiency. We evaluate the proposed architecture through simulation in a network of vehicles. △ Less

Submitted 24 May, 2019; v1 submitted 7 March, 2019; originally announced March 2019.

Comments: 6 pages, 2 figures, 1 table, conference

Simulation to Scaled City: Zero-Shot Policy Transfer for Traffic Control via Autonomous Vehicles

Authors: Kathy Jang, Eugene Vinitsky, Behdad Chalaki, Ben Remer, Logan Beaver, Andreas Malikopoulos, Alexandre Bayen

Abstract: Using deep reinforcement learning, we train control policies for autonomous vehicles leading a platoon of vehicles onto a roundabout. Using Flow, a library for deep reinforcement learning in micro-simulators, we train two policies, one policy with noise injected into the state and action space and one without any injected noise. In simulation, the autonomous vehicle learns an emergent metering beh… ▽ More Using deep reinforcement learning, we train control policies for autonomous vehicles leading a platoon of vehicles onto a roundabout. Using Flow, a library for deep reinforcement learning in micro-simulators, we train two policies, one policy with noise injected into the state and action space and one without any injected noise. In simulation, the autonomous vehicle learns an emergent metering behavior for both policies in which it slows to allow for smoother merging. We then directly transfer this policy without any tuning to the University of Delaware Scaled Smart City (UDSSC), a 1:25 scale testbed for connected and automated vehicles. We characterize the performance of both policies on the scaled city. We show that the noise-free policy winds up crashing and only occasionally metering. However, the noise-injected policy consistently performs the metering behavior and remains collision-free, suggesting that the noise helps with the zero-shot policy transfer. Additionally, the transferred, noise-injected policy leads to a 5% reduction of average travel time and a reduction of 22% in maximum travel time in the UDSSC. Videos of the controllers can be found at https://sites.google.com/view/iccps-policy-transfer. △ Less

Submitted 22 February, 2019; v1 submitted 14 December, 2018; originally announced December 2018.

Comments: To be published at the International Conference on Cyber Physical Systems (ICCPS) 2019. 10 pages, 9 figures

ACM Class: I.2.1; I.2.4; I.2.6; I.2.10; I.6.5