Showing 1–7 of 7 results for author: Kazachkov, A M

Machine Learning for Optimization-Based Separation: the Case of Mixed-Integer Rounding Cuts

Authors: Oscar Guaje, Arnaud Deza, Aleksandr M. Kazachkov, Elias B. Khalil

Abstract: Mixed-Integer Rounding (MIR) cuts are effective at improving the dual bound in Mixed-Integer Linear Programming (MIP). However, in practice, MIR cuts are separated heuristically rather than using optimization as the latter is prohibitively expensive. We present a hybrid cut generation framework in which we train a Machine Learning (ML) model to inform cut generation for a family of similar instanc… ▽ More Mixed-Integer Rounding (MIR) cuts are effective at improving the dual bound in Mixed-Integer Linear Programming (MIP). However, in practice, MIR cuts are separated heuristically rather than using optimization as the latter is prohibitively expensive. We present a hybrid cut generation framework in which we train a Machine Learning (ML) model to inform cut generation for a family of similar instances. Our framework solves a MIP-based separation problem to generate high-quality MIR cuts, then learns to identify useful constraints that led to these effective cuts. At test time, the predictions of the ML model allow us to solve a reduced MIP-based separation problem. We present computational results for this approach on datasets of randomly perturbed MIPLIB2017 instances. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Symmetrically Fair Allocations of Indivisible Goods

Authors: Connor Johnston, Aleksandr M. Kazachkov

Abstract: We consider allocating indivisible goods with provable fairness guarantees that are satisfied regardless of which bundle of items each agent receives. Symmetrical allocations of this type are known to exist for divisible resources, such as consensus splitting of a cake into parts, each having equal value for all agents, ensuring that in any allocation of the cake slices, no agent would envy anothe… ▽ More We consider allocating indivisible goods with provable fairness guarantees that are satisfied regardless of which bundle of items each agent receives. Symmetrical allocations of this type are known to exist for divisible resources, such as consensus splitting of a cake into parts, each having equal value for all agents, ensuring that in any allocation of the cake slices, no agent would envy another. For indivisible goods, one analogous concept relaxes envy freeness to guarantee the existence of an allocation in which any bundle is worth as much as any other, up to the value of a bounded number of items from the other bundle. Previous work has studied the number of items that need to be removed. In this paper, we improve upon these bounds for the specific setting in which the number of bundles equals the number of agents. Concretely, we develop the theory of symmetrically envy free up to one good, or symEF1, allocations. We prove that a symEF1 allocation exists if the vertices of a related graph can be partitioned (colored) into as many independent sets as there are agents. This sufficient condition always holds for two agents, and for agents that have identical, disjoint, or binary valuations. We further prove conditions under which exponentially-many distinct symEF1 allocations exist. Finally, we perform computational experiments to study the incidence of symEF1 allocations as a function of the number of agents and items when valuations are drawn uniformly at random. △ Less

Submitted 19 June, 2024; originally announced June 2024.

Monoidal strengthening of simple $\mathcal{V}$-polyhedral disjunctive cuts

Authors: Aleksandr M. Kazachkov, Egon Balas

Abstract: Disjunctive cutting planes can tighten a relaxation of a mixed-integer linear program. Traditionally, such cuts are obtained by solving a higher-dimensional linear program, whose additional variables cause the procedure to be computationally prohibitive. Adopting a $\mathcal{V}$-polyhedral perspective is a practical alternative that enables the separation of disjunctive cuts via a linear program w… ▽ More Disjunctive cutting planes can tighten a relaxation of a mixed-integer linear program. Traditionally, such cuts are obtained by solving a higher-dimensional linear program, whose additional variables cause the procedure to be computationally prohibitive. Adopting a $\mathcal{V}$-polyhedral perspective is a practical alternative that enables the separation of disjunctive cuts via a linear program with only as many variables as the original problem. The drawback is that the classical approach of monoidal strengthening cannot be directly employed without the values of the extra variables appearing in the extended formulation. We derive how to compute these values from a solution to the linear program generating $\mathcal{V}$-polyhedral disjunctive cuts. We then present computational experiments with monoidal strengthening of cuts from disjunctions with as many as 64 terms. Some instances are dramatically impacted, with strengthening increasing the gap closed by the cuts from 0 to 100%. However, for larger disjunctions, monoidal strengthening appears to be less effective, for which we identify a potential cause. △ Less

Submitted 1 March, 2023; originally announced March 2023.

MSC Class: 90C11

$\mathcal{V}$-Polyhedral Disjunctive Cuts

Authors: Egon Balas, Aleksandr M. Kazachkov

Abstract: We introduce $\mathcal{V}$-polyhedral disjunctive cuts (VPCs) for generating valid inequalities from general disjunctions. Cuts are critical to integer programming solvers, but the benefit from many families is only realized when the cuts are applied recursively, causing numerical instability and "tailing off" of cut strength after several rounds. To mitigate these difficulties, the VPC framework… ▽ More We introduce $\mathcal{V}$-polyhedral disjunctive cuts (VPCs) for generating valid inequalities from general disjunctions. Cuts are critical to integer programming solvers, but the benefit from many families is only realized when the cuts are applied recursively, causing numerical instability and "tailing off" of cut strength after several rounds. To mitigate these difficulties, the VPC framework offers a practical method for generating strong cuts without resorting to recursion. The framework starts with a disjunction whose terms partition the feasible region into smaller subproblems, then obtains a collection of points and rays from the disjunctive terms, from which we build a linear program whose feasible solutions correspond to valid disjunctive cuts. Though a naïve implementation would result in an exponentially-sized optimization problem, we show how to efficiently construct this linear program, such that it is much smaller than the one from the alternative higher-dimensional cut-generating linear program. This enables us to test strong multiterm disjunctions that arise from the leaf nodes of a partial branch-and-bound tree. In addition to proving useful theoretical properties of the cuts, we evaluate their performance computationally through an implementation in the open-source COIN-OR framework. In the results, VPCs from a strong disjunction significantly improve the gap closed compared to existing cuts in solvers, and they also decrease some instances' solving time when used with branch and bound. △ Less

Submitted 18 February, 2024; v1 submitted 27 July, 2022; originally announced July 2022.

MSC Class: 90C11

The Machine Learning for Combinatorial Optimization Competition (ML4CO): Results and Insights

Authors: Maxime Gasse, Quentin Cappart, Jonas Charfreitag, Laurent Charlin, Didier Chételat, Antonia Chmiela, Justin Dumouchelle, Ambros Gleixner, Aleksandr M. Kazachkov, Elias Khalil, Pawel Lichocki, Andrea Lodi, Miles Lubin, Chris J. Maddison, Christopher Morris, Dimitri J. Papageorgiou, Augustin Parjadis, Sebastian Pokutta, Antoine Prouvost, Lara Scavuzzo, Giulia Zarpellon, Linxin Yang, Sha Lai, Akang Wang, Xiaodong Luo , et al. (16 additional authors not shown)

Abstract: Combinatorial optimization is a well-established area in operations research and computer science. Until recently, its methods have focused on solving problem instances in isolation, ignoring that they often stem from related data distributions in practice. However, recent years have seen a surge of interest in using machine learning as a new approach for solving combinatorial problems, either dir… ▽ More Combinatorial optimization is a well-established area in operations research and computer science. Until recently, its methods have focused on solving problem instances in isolation, ignoring that they often stem from related data distributions in practice. However, recent years have seen a surge of interest in using machine learning as a new approach for solving combinatorial problems, either directly as solvers or by enhancing exact solvers. Based on this context, the ML4CO aims at improving state-of-the-art combinatorial optimization solvers by replacing key heuristic components. The competition featured three challenging tasks: finding the best feasible solution, producing the tightest optimality certificate, and giving an appropriate solver configuration. Three realistic datasets were considered: balanced item placement, workload apportionment, and maritime inventory routing. This last dataset was kept anonymous for the contestants. △ Less

Submitted 17 March, 2022; v1 submitted 4 March, 2022; originally announced March 2022.

Comments: Neurips 2021 competition. arXiv admin note: text overlap with arXiv:2112.12251 by other authors

An Abstract Model for Branch and Cut

Authors: Aleksandr M. Kazachkov, Pierre Le Bodic, Sriram Sankaranarayanan

Abstract: Branch and cut is the dominant paradigm for solving a wide range of mathematical programming problems -- linear or nonlinear -- combining efficient search (via branch and bound) and relaxation-tightening procedures (via cutting planes, or cuts). While there is a wealth of computational experience behind existing cutting strategies, there is simultaneously a relative lack of theoretical explanation… ▽ More Branch and cut is the dominant paradigm for solving a wide range of mathematical programming problems -- linear or nonlinear -- combining efficient search (via branch and bound) and relaxation-tightening procedures (via cutting planes, or cuts). While there is a wealth of computational experience behind existing cutting strategies, there is simultaneously a relative lack of theoretical explanations for these choices, and for the tradeoffs involved therein. Recent papers have explored abstract models for branching and for comparing cuts with branch and bound. However, to model practice, it is crucial to understand the impact of jointly considering branching and cutting decisions. In this paper, we provide a framework for analyzing how cuts affect the size of branch-and-cut trees, as well as their impact on solution time. Our abstract model captures some of the key characteristics of real-world phenomena in branch-and-cut experiments, regarding whether to generate cuts only at the root or throughout the tree, how many rounds of cuts to add before starting to branch, and why cuts seem to exhibit nonmonotonic effects on the solution process. △ Less

Submitted 8 July, 2023; v1 submitted 18 November, 2021; originally announced November 2021.

MSC Class: 90C10; 90C11; 90C57

Partial hyperplane activation for generalized intersection cuts

Authors: Aleksandr M. Kazachkov, Selvaprabu Nadarajah, Egon Balas, François Margot

Abstract: The generalized intersection cut (GIC) paradigm is a recent framework for generating cutting planes in mixed integer programming with attractive theoretical properties. We investigate this computationally unexplored paradigm and observe that a key hyperplane activation procedure embedded in it is not computationally viable. To overcome this issue, we develop a novel replacement to this procedure c… ▽ More The generalized intersection cut (GIC) paradigm is a recent framework for generating cutting planes in mixed integer programming with attractive theoretical properties. We investigate this computationally unexplored paradigm and observe that a key hyperplane activation procedure embedded in it is not computationally viable. To overcome this issue, we develop a novel replacement to this procedure called partial hyperplane activation (PHA), introduce a variant of PHA based on a notion of hyperplane tilting, and prove the validity of both algorithms. We propose several implementation strategies and parameter choices for our PHA algorithms and provide supporting theoretical results. We computationally evaluate these ideas in the COIN-OR framework on MIPLIB instances. Our findings shed light on the the strengths of the PHA approach as well as suggest properties related to strong cuts that can be targeted in the future. △ Less

Submitted 16 December, 2018; v1 submitted 7 March, 2017; originally announced March 2017.

Comments: Updated with results from two rounds of cuts, comparison to lift-and-project cuts results from the literature, and improved presentation of Section 4

MSC Class: 90C11