Zum Hauptinhalt springen

Showing 1–19 of 19 results for author: Simeonov, A

.
  1. arXiv:2409.00588  [pdf, other

    cs.RO cs.LG

    Diffusion Policy Policy Optimization

    Authors: Allen Z. Ren, Justin Lidard, Lars L. Ankile, Anthony Simeonov, Pulkit Agrawal, Anirudha Majumdar, Benjamin Burchfiel, Hongkai Dai, Max Simchowitz

    Abstract: We introduce Diffusion Policy Policy Optimization, DPPO, an algorithmic framework including best practices for fine-tuning diffusion-based policies (e.g. Diffusion Policy) in continuous control and robot learning tasks using the policy gradient (PG) method from reinforcement learning (RL). PG methods are ubiquitous in training RL policies with other policy parameterizations; nevertheless, they had… ▽ More

    Submitted 31 August, 2024; originally announced September 2024.

    Comments: Website: diffusion-ppo.github.io

  2. arXiv:2407.16677  [pdf, other

    cs.RO cs.LG

    From Imitation to Refinement -- Residual RL for Precise Visual Assembly

    Authors: Lars Ankile, Anthony Simeonov, Idan Shenfeld, Marcel Torne, Pulkit Agrawal

    Abstract: Behavior cloning (BC) currently stands as a dominant paradigm for learning real-world visual manipulation. However, in tasks that require locally corrective behaviors like multi-part assembly, learning robust policies purely from human demonstrations remains challenging. Reinforcement learning (RL) can mitigate these limitations by allowing policies to acquire locally corrective behaviors through… ▽ More

    Submitted 23 July, 2024; originally announced July 2024.

  3. arXiv:2404.03729  [pdf, other

    cs.RO cs.LG

    JUICER: Data-Efficient Imitation Learning for Robotic Assembly

    Authors: Lars Ankile, Anthony Simeonov, Idan Shenfeld, Pulkit Agrawal

    Abstract: While learning from demonstrations is powerful for acquiring visuomotor policies, high-performance imitation without large demonstration datasets remains challenging for tasks requiring precise, long-horizon manipulation. This paper proposes a pipeline for improving imitation learning performance with a small human demonstration budget. We apply our approach to assembly tasks that require precisel… ▽ More

    Submitted 9 April, 2024; v1 submitted 4 April, 2024; originally announced April 2024.

    Comments: Project website: https://imitation-juicer.github.io/

  4. arXiv:2403.03949  [pdf, other

    cs.RO cs.AI cs.LG

    Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation

    Authors: Marcel Torne, Anthony Simeonov, Zechu Li, April Chan, Tao Chen, Abhishek Gupta, Pulkit Agrawal

    Abstract: Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment autonomously to learn robust behaviors but may require impractical amounts of unsafe real-world data collection. To learn performant, robust policies without the burde… ▽ More

    Submitted 6 March, 2024; originally announced March 2024.

    Comments: Project page: https://real-to-sim-to-real.github.io/RialTo/

  5. arXiv:2309.14321  [pdf, other

    cs.RO cs.LG

    Lifelong Robot Learning with Human Assisted Language Planners

    Authors: Meenal Parakh, Alisha Fong, Anthony Simeonov, Tao Chen, Abhishek Gupta, Pulkit Agrawal

    Abstract: Large Language Models (LLMs) have been shown to act like planners that can decompose high-level instructions into a sequence of executable instructions. However, current LLM-based planners are only able to operate with a fixed set of skills. We overcome this critical limitation and present a method for using LLM-based planners to query new skills and teach robots these skills in a data and time-ef… ▽ More

    Submitted 24 October, 2023; v1 submitted 25 September, 2023; originally announced September 2023.

  6. arXiv:2307.04751  [pdf, other

    cs.RO cs.CV cs.LG

    Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangement

    Authors: Anthony Simeonov, Ankit Goyal, Lucas Manuelli, Lin Yen-Chen, Alina Sarmiento, Alberto Rodriguez, Pulkit Agrawal, Dieter Fox

    Abstract: We propose a system for rearranging objects in a scene to achieve a desired object-scene placing relationship, such as a book inserted in an open slot of a bookshelf. The pipeline generalizes to novel geometries, poses, and layouts of both scenes and objects, and is trained from demonstrations to operate directly on 3D point clouds. Our system overcomes challenges associated with the existence of… ▽ More

    Submitted 10 July, 2023; originally announced July 2023.

    Comments: Project page: https://anthonysimeonov.github.io/rpdiff-multi-modal/

  7. arXiv:2302.03573  [pdf, other

    cs.RO cs.AI cs.CV cs.LG

    Local Neural Descriptor Fields: Locally Conditioned Object Representations for Manipulation

    Authors: Ethan Chun, Yilun Du, Anthony Simeonov, Tomas Lozano-Perez, Leslie Kaelbling

    Abstract: A robot operating in a household environment will see a wide range of unique and unfamiliar objects. While a system could train on many of these, it is infeasible to predict all the objects a robot will see. In this paper, we present a method to generalize object manipulation skills acquired from a limited number of demonstrations, to novel objects from unseen shape categories. Our approach, Local… ▽ More

    Submitted 6 March, 2023; v1 submitted 7 February, 2023; originally announced February 2023.

    Comments: ICRA 2023, Project Page: https://elchun.github.io/lndf/

  8. arXiv:2212.06088  [pdf, other

    cs.RO

    MIRA: Mental Imagery for Robotic Affordances

    Authors: Lin Yen-Chen, Pete Florence, Andy Zeng, Jonathan T. Barron, Yilun Du, Wei-Chiu Ma, Anthony Simeonov, Alberto Rodriguez Garcia, Phillip Isola

    Abstract: Humans form mental images of 3D scenes to support counterfactual imagination, planning, and motor control. Our abilities to predict the appearance and affordance of the scene from previously unobserved viewpoints aid us in performing manipulation tasks (e.g., 6-DoF kitting) with a level of ease that is currently out of reach for existing robot learning frameworks. In this work, we aim to build art… ▽ More

    Submitted 12 December, 2022; originally announced December 2022.

    Comments: CoRL 2022, webpage: https://yenchenlin.me/mira

  9. arXiv:2211.09786  [pdf, other

    cs.RO cs.CV cs.LG

    SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fields

    Authors: Anthony Simeonov, Yilun Du, Lin Yen-Chen, Alberto Rodriguez, Leslie Pack Kaelbling, Tomas Lozano-Perez, Pulkit Agrawal

    Abstract: We present a method for performing tasks involving spatial relations between novel object instances initialized in arbitrary poses directly from point cloud observations. Our framework provides a scalable way for specifying new tasks using only 5-10 demonstrations. Object rearrangement is formalized as the question of finding actions that configure task-relevant parts of the object in a desired al… ▽ More

    Submitted 17 November, 2022; originally announced November 2022.

    Comments: CoRL 2022, first two authors contributed equally, website and code: https://anthonysimeonov.github.io/r-ndf/

  10. arXiv:2112.05124  [pdf, other

    cs.RO cs.AI cs.CV cs.LG

    Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation

    Authors: Anthony Simeonov, Yilun Du, Andrea Tagliasacchi, Joshua B. Tenenbaum, Alberto Rodriguez, Pulkit Agrawal, Vincent Sitzmann

    Abstract: We present Neural Descriptor Fields (NDFs), an object representation that encodes both points and relative poses between an object and a target (such as a robot gripper or a rack used for hanging) via category-level descriptors. We employ this representation for object manipulation, where given a task demonstration, we want to repeat the same task on a new object instance from the same category. W… ▽ More

    Submitted 9 December, 2021; originally announced December 2021.

    Comments: Website: https://yilundu.github.io/ndf/. First two authors contributed equally (order determined by coin flip), last two authors equal advising

  11. arXiv:2011.08177  [pdf, other

    cs.RO cs.LG

    A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects

    Authors: Anthony Simeonov, Yilun Du, Beomjoon Kim, Francois R. Hogan, Joshua Tenenbaum, Pulkit Agrawal, Alberto Rodriguez

    Abstract: We present a framework for solving long-horizon planning problems involving manipulation of rigid objects that operates directly from a point-cloud observation, i.e. without prior object models. Our method plans in the space of object subgoals and frees the planner from reasoning about robot-object interaction dynamics by relying on a set of generalizable manipulation primitives. We show that for… ▽ More

    Submitted 16 November, 2020; originally announced November 2020.

    Comments: Conference on Robot Learning (CoRL 2020): Project website: https://anthonysimeonov.github.io/rpo-planning-framework/

  12. arXiv:2007.12242  [pdf

    q-bio.QM stat.AP

    Mining of high throughput screening database reveals AP-1 and autophagy pathways as potential targets for COVID-19 therapeutics

    Authors: Hu Zhu, Catherine Z. Chen, Srilatha Sakamuru, Anton Simeonov, Mathew D. Hall, Menghang Xia, Wei Zheng, Ruili Huang

    Abstract: The recent global pandemic of Coronavirus Disease 2019 (COVID-19) caused by the new coronavirus SARS-CoV-2 presents an urgent need for new therapeutic candidates. Many efforts have been devoted to screening existing drug libraries with the hope to repurpose approved drugs as potential treatments for COVID-19. However, the antiviral mechanisms of action for the drugs found active in these phenotypi… ▽ More

    Submitted 23 July, 2020; originally announced July 2020.

  13. arXiv:1907.06013  [pdf, other

    cs.RO cs.AI cs.LG

    Motion Planning Networks: Bridging the Gap Between Learning-based and Classical Motion Planners

    Authors: Ahmed H. Qureshi, Yinglong Miao, Anthony Simeonov, Michael C. Yip

    Abstract: This paper describes Motion Planning Networks (MPNet), a computationally efficient, learning-based neural planner for solving motion planning problems. MPNet uses neural networks to learn general near-optimal heuristics for path planning in seen and unseen environments. It takes environment information such as raw point-cloud from depth sensors, as well as a robot's initial and desired goal config… ▽ More

    Submitted 27 June, 2020; v1 submitted 13 July, 2019; originally announced July 2019.

    Comments: Supplementary material including implementation parameters and project videos are available at https://sites.google.com/view/mpnet/home. This work has been accepted for publication at IEEE Transactions on Robotics

  14. arXiv:1806.05767  [pdf, other

    cs.RO cs.AI stat.ML

    Motion Planning Networks

    Authors: Ahmed H. Qureshi, Anthony Simeonov, Mayur J. Bency, Michael C. Yip

    Abstract: Fast and efficient motion planning algorithms are crucial for many state-of-the-art robotics applications such as self-driving cars. Existing motion planning methods become ineffective as their computational complexity increases exponentially with the dimensionality of the motion planning problem. To address this issue, we present Motion Planning Networks (MPNet), a neural network-based novel plan… ▽ More

    Submitted 24 February, 2019; v1 submitted 14 June, 2018; originally announced June 2018.

    Comments: Paper published in ICRA'19

  15. arXiv:1702.03588  [pdf, other

    physics.bio-ph

    Properties of cyanobacterial UV-absorbing pigments suggest their evolution was driven by optimizing photon dissipation rather than photoprotection

    Authors: Aleksandar Simeonov, Karo Michaelian

    Abstract: An ancient repertoire of UV absorbing pigments which survive today in the phylogenetically oldest extant photosynthetic organisms the cyanobacteria point to a direction in evolutionary adaptation of the pigments and their associated biota from largely UVC absorbing pigments in the Archean to pigments covering ever more of the longer wavelength UV and visible in the Phanerozoic.Such a scenario impl… ▽ More

    Submitted 7 October, 2019; v1 submitted 12 February, 2017; originally announced February 2017.

    Comments: 5 figures, 1 table

  16. arXiv:1608.08847  [pdf

    astro-ph.EP physics.bio-ph

    Thermodynamic Explanation for the Cosmic Ubiquity of Organic Pigments

    Authors: Karo Michaelian, Aleksandar Simeonov

    Abstract: There is increasingly more evidence being accumulated for the occurrence of large amounts of organic material in the cosmos, particularly in the form of aromatic compounds. These molecules can be found on the surface of Earth and Mars, in the atmospheres of the larger planets and on many of their satellites, on asteroids, comets, meteorites, the atmospheres of red giant stars, interstellar nebulae… ▽ More

    Submitted 6 July, 2016; originally announced August 2016.

    Comments: 23 pages, no figures

    Journal ref: Astrobiol Outreach 5:156 (2017)

  17. arXiv:1411.5695  [pdf

    physics.bio-ph q-bio.QM q-bio.TO

    High-throughput screening for modulators of cellular contractile force

    Authors: Chan Young Park, Enhua H. Zhou, Dhananjay Tambe, Bohao Chen, Tera Lavoie, Maria Dowell, Anton Simeonov, David J. Maloney, Aleksandar Marinkovic, Daniel J. Tschumperlin, Stephanie Burger, Matthew Frykenberg, James P. Butler, W. Daniel Stamer, Mark Johnson, Julian Solway, Jeffrey J. Fredberg, Ramaswamy Krishnan

    Abstract: When cellular contractile forces are central to pathophysiology, these forces comprise a logical target of therapy. Nevertheless, existing high-throughput screens are limited to upstream signaling intermediates with poorly defined relationship to such a physiological endpoint. Using cellular force as the target, here we screened libraries to identify novel drug candidates in the case of human airw… ▽ More

    Submitted 20 November, 2014; originally announced November 2014.

  18. arXiv:1405.4059  [pdf

    physics.bio-ph q-bio.BM

    Fundamental Molecules of Life are Pigments which Arose and Evolved to Dissipate the Solar Spectrum

    Authors: Karo Michaelian, Aleksandar Simeonov

    Abstract: The driving force behind the origin and evolution of life has been the thermodynamic imperative of increasing the entropy production of the biosphere through increasing the global solar photon dissipation rate. In the upper atmosphere of today, oxygen and ozone derived from life processes are performing the short wavelength UVC and UVB dissipation. On Earth's surface, water and organic pigments in… ▽ More

    Submitted 28 May, 2014; v1 submitted 15 May, 2014; originally announced May 2014.

    Comments: 43 pages, 3 figures

    Journal ref: Biogeosciences, 12, 4913-4937, 2015

  19. arXiv:0910.2434  [pdf, other

    physics.flu-dyn

    Direct Numerical Simulation of 3D Salt Fingers: From Secondary Instability to Chaotic Convection

    Authors: Julian A. Simeonov, Melvin E. Stern, Timour Radko

    Abstract: The amplification and equilibration of three-dimensional salt fingers in unbounded uniform vertical gradients of temperature and salinity is modeled with a Direct Numerical Simulation in a triply periodic computational domain. A fluid dynamics video of the simulation shows that the secondary instability of the fastest growing square-planform finger mode is a combination of the well-known vertica… ▽ More

    Submitted 15 October, 2009; v1 submitted 13 October, 2009; originally announced October 2009.

    Comments: APS DFD Gallery of Fluid Motion 2009