-
Alternative Interfaces for Human-initiated Natural Language Communication and Robot-initiated Haptic Feedback: Towards Better Situational Awareness in Human-Robot Collaboration
Authors:
Callum Bennie,
Bridget Casey,
Cecile Paris,
Dana Kulic,
Brendan Tidd,
Nicholas Lawrance,
Alex Pitt,
Fletcher Talbot,
Jason Williams,
David Howard,
Pavan Sikka,
Hashini Senaratne
Abstract:
This article presents an implementation of a natural-language speech interface and a haptic feedback interface that enables a human supervisor to provide guidance to, request information, and receive status updates from a Spot robot. We provide insights gained during preliminary user testing of the interface in a realistic robot exploration scenario.
This article presents an implementation of a natural-language speech interface and a haptic feedback interface that enables a human supervisor to provide guidance to, request information, and receive status updates from a Spot robot. We provide insights gained during preliminary user testing of the interface in a realistic robot exploration scenario.
△ Less
Submitted 24 January, 2024;
originally announced January 2024.
-
Heterogeneous robot teams with unified perception and autonomy: How Team CSIRO Data61 tied for the top score at the DARPA Subterranean Challenge
Authors:
Navinda Kottege,
Jason Williams,
Brendan Tidd,
Fletcher Talbot,
Ryan Steindl,
Mark Cox,
Dennis Frousheger,
Thomas Hines,
Alex Pitt,
Benjamin Tam,
Brett Wood,
Lauren Hanson,
Katrina Lo Surdo,
Thomas Molnar,
Matt Wildie,
Kazys Stepanas,
Gavin Catt,
Lachlan Tychsen-Smith,
Dean Penfold,
Leslie Overs,
Milad Ramezani,
Kasra Khosoussi,
Farid Kendoul,
Glenn Wagner,
Duncan Palmer
, et al. (5 additional authors not shown)
Abstract:
The DARPA Subterranean Challenge was designed for competitors to develop and deploy teams of autonomous robots to explore difficult unknown underground environments. Categorised in to human-made tunnels, underground urban infrastructure and natural caves, each of these subdomains had many challenging elements for robot perception, locomotion, navigation and autonomy. These included degraded wirele…
▽ More
The DARPA Subterranean Challenge was designed for competitors to develop and deploy teams of autonomous robots to explore difficult unknown underground environments. Categorised in to human-made tunnels, underground urban infrastructure and natural caves, each of these subdomains had many challenging elements for robot perception, locomotion, navigation and autonomy. These included degraded wireless communication, poor visibility due to smoke, narrow passages and doorways, clutter, uneven ground, slippery and loose terrain, stairs, ledges, overhangs, dripping water, and dynamic obstacles that move to block paths among others. In the Final Event of this challenge held in September 2021, the course consisted of all three subdomains. The task was for the robot team to perform a scavenger hunt for a number of pre-defined artefacts within a limited time frame. Only one human supervisor was allowed to communicate with the robots once they were in the course. Points were scored when accurate detections and their locations were communicated back to the scoring server. A total of 8 teams competed in the finals held at the Mega Cavern in Louisville, KY, USA. This article describes the systems deployed by Team CSIRO Data61 that tied for the top score and won second place at the event.
△ Less
Submitted 25 February, 2023;
originally announced February 2023.
-
Human-Robot Team Performance Compared to Full Robot Autonomy in 16 Real-World Search and Rescue Missions: Adaptation of the DARPA Subterranean Challenge
Authors:
Nicole Robinson,
Jason Williams,
David Howard,
Brendan Tidd,
Fletcher Talbot,
Brett Wood,
Alex Pitt,
Navinda Kottege,
Dana Kulić
Abstract:
Human operators in human-robot teams are commonly perceived to be critical for mission success. To explore the direct and perceived impact of operator input on task success and team performance, 16 real-world missions (10 hrs) were conducted based on the DARPA Subterranean Challenge. These missions were to deploy a heterogeneous team of robots for a search task to locate and identify artifacts suc…
▽ More
Human operators in human-robot teams are commonly perceived to be critical for mission success. To explore the direct and perceived impact of operator input on task success and team performance, 16 real-world missions (10 hrs) were conducted based on the DARPA Subterranean Challenge. These missions were to deploy a heterogeneous team of robots for a search task to locate and identify artifacts such as climbing rope, drills and mannequins representing human survivors. Two conditions were evaluated: human operators that could control the robot team with state-of-the-art autonomy (Human-Robot Team) compared to autonomous missions without human operator input (Robot-Autonomy). Human-Robot Teams were often in directed autonomy mode (70% of mission time), found more items, traversed more distance, covered more unique ground, and had a higher time between safety-related events. Human-Robot Teams were faster at finding the first artifact, but slower to respond to information from the robot team. In routine conditions, scores were comparable for artifacts, distance, and coverage. Reasons for intervention included creating waypoints to prioritise high-yield areas, and to navigate through error-prone spaces. After observing robot autonomy, operators reported increases in robot competency and trust, but that robot behaviour was not always transparent and understandable, even after high mission performance.
△ Less
Submitted 11 December, 2022;
originally announced December 2022.
-
Deploying COTS Legged Robot Platforms into a Heterogeneous Robot Team
Authors:
Benjamin Tam,
Thomas Molnar,
Fletcher Talbot,
Brett Wood,
Ryan Steindl
Abstract:
The recent availability of commercial-off-the-shelf (COTS) legged robot platforms have opened up new opportunities in deploying legged systems into different scenarios. While the main advantage of legged robots is their ability to traverse unstructured terrain, there are still large gaps between what robot platforms can achieve and their animal counterparts. Therefore, when deploying as part of a…
▽ More
The recent availability of commercial-off-the-shelf (COTS) legged robot platforms have opened up new opportunities in deploying legged systems into different scenarios. While the main advantage of legged robots is their ability to traverse unstructured terrain, there are still large gaps between what robot platforms can achieve and their animal counterparts. Therefore, when deploying as part of a heterogeneous robot team of different platforms, it is beneficial to understand the different scenarios where a legged platform would perform better than a wheeled, tracked or aerial platform. Two COTS quadruped robots, Ghost Robotics' Vision 60 and Boston Dynamics' Spot, were deployed into a heterogeneous team. A description of some of the challenges faced while integrating the platforms, as well as some experiments in traversing different terrains are provided to give insight into the real-world deployment of legged robots.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Heterogeneous Ground and Air Platforms, Homogeneous Sensing: Team CSIRO Data61's Approach to the DARPA Subterranean Challenge
Authors:
Nicolas Hudson,
Fletcher Talbot,
Mark Cox,
Jason Williams,
Thomas Hines,
Alex Pitt,
Brett Wood,
Dennis Frousheger,
Katrina Lo Surdo,
Thomas Molnar,
Ryan Steindl,
Matt Wildie,
Inkyu Sa,
Navinda Kottege,
Kazys Stepanas,
Emili Hernandez,
Gavin Catt,
William Docherty,
Brendan Tidd,
Benjamin Tam,
Simon Murrell,
Mitchell Bessell,
Lauren Hanson,
Lachlan Tychsen-Smith,
Hajime Suzuki
, et al. (9 additional authors not shown)
Abstract:
Heterogeneous teams of robots, leveraging a balance between autonomy and human interaction, bring powerful capabilities to the problem of exploring dangerous, unstructured subterranean environments. Here we describe the solution developed by Team CSIRO Data61, consisting of CSIRO, Emesent and Georgia Tech, during the DARPA Subterranean Challenge. These presented systems were fielded in the Tunnel…
▽ More
Heterogeneous teams of robots, leveraging a balance between autonomy and human interaction, bring powerful capabilities to the problem of exploring dangerous, unstructured subterranean environments. Here we describe the solution developed by Team CSIRO Data61, consisting of CSIRO, Emesent and Georgia Tech, during the DARPA Subterranean Challenge. These presented systems were fielded in the Tunnel Circuit in August 2019, the Urban Circuit in February 2020, and in our own Cave event, conducted in September 2020. A unique capability of the fielded team is the homogeneous sensing of the platforms utilised, which is leveraged to obtain a decentralised multi-agent SLAM solution on each platform (both ground agents and UAVs) using peer-to-peer communications. This enabled a shift in focus from constructing a pervasive communications network to relying on multi-agent autonomy, motivated by experiences in early circuit events. These experiences also showed the surprising capability of rugged tracked platforms for challenging terrain, which in turn led to the heterogeneous team structure based on a BIA5 OzBot Titan ground robot and an Emesent Hovermap UAV, supplemented by smaller tracked or legged ground robots. The ground agents use a common CatPack perception module, which allowed reuse of the perception and autonomy stack across all ground agents with minimal adaptation.
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
Bruce -- Design and Development of a Dynamic Hexapod Robot
Authors:
Ryan Steindl,
Thomas Molnar,
Fletcher Talbot,
Nicolas Hudson,
Benjamin Tam,
Simon Murrell,
Navinda Kottege
Abstract:
This paper introduces Bruce, the CSIRO Dynamic Hexapod Robot capable of autonomous, dynamic locomotion over difficult terrain. This robot is built around Apptronik linear series elastic actuators, and went from design to deployment in under a year by using approximately 80\% 3D printed structural (joints and link) parts. The robot has so far demonstrated rough terrain traversal over grass, rocks a…
▽ More
This paper introduces Bruce, the CSIRO Dynamic Hexapod Robot capable of autonomous, dynamic locomotion over difficult terrain. This robot is built around Apptronik linear series elastic actuators, and went from design to deployment in under a year by using approximately 80\% 3D printed structural (joints and link) parts. The robot has so far demonstrated rough terrain traversal over grass, rocks and rubble at 0.3m/s, and flat-ground speeds up to 0.5m/s. This was achieved with a simple controller, inspired by RHex, with a central pattern generator, task-frame impedance control for individual legs and no foot contact detection. The robot is designed to move at up to 1.0m/s on flat ground with appropriate control, and was deployed into the the DARPA SubT Challenge Tunnel circuit event in August 2019.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Virtual Surfaces and Attitude Aware Planning and Behaviours for Negative Obstacle Navigation
Authors:
Thomas Hines,
Kazys Stepanas,
Fletcher Talbot,
Inkyu Sa,
Jake Lewis,
Emili Hernandez,
Navinda Kottege,
Nicolas Hudson
Abstract:
This paper presents an autonomous navigation system for ground robots traversing aggressive unstructured terrain through a cohesive arrangement of mapping, deliberative planning and reactive behaviour modules. All systems are aware of terrain slope, visibility and vehicle orientation, enabling robots to recognize, plan and react around unobserved areas and overcome negative obstacles, slopes, step…
▽ More
This paper presents an autonomous navigation system for ground robots traversing aggressive unstructured terrain through a cohesive arrangement of mapping, deliberative planning and reactive behaviour modules. All systems are aware of terrain slope, visibility and vehicle orientation, enabling robots to recognize, plan and react around unobserved areas and overcome negative obstacles, slopes, steps, overhangs and narrow passageways. This is one of pioneer works to explicitly and simultaneously couple mapping, planning and reactive components in dealing with negative obstacles. The system was deployed on three heterogeneous ground robots for the DARPA Subterranean Challenge, and we present results in Urban and Cave environments, along with simulated scenarios, that demonstrate this approach.
△ Less
Submitted 21 January, 2021; v1 submitted 29 October, 2020;
originally announced October 2020.
-
OpenSHC: A Versatile Multilegged Robot Controller
Authors:
Benjamin Tam,
Fletcher Talbot,
Ryan Steindl,
Alberto Elfes,
Navinda Kottege
Abstract:
Multilegged robots have the ability to perform stable locomotion on relatively rough terrain. However, the complexity of legged robots over wheeled or tracked robots make them difficult to control. This paper presents OpenSHC (Open-source Syropod High-level Controller), a versatile high-level controller {capable of generating gaits and poses for quasi-static multilegged robots, both simulated and…
▽ More
Multilegged robots have the ability to perform stable locomotion on relatively rough terrain. However, the complexity of legged robots over wheeled or tracked robots make them difficult to control. This paper presents OpenSHC (Open-source Syropod High-level Controller), a versatile high-level controller {capable of generating gaits and poses for quasi-static multilegged robots, both simulated and with real hardware implementations. With full Robot Operating System (ROS) integration, the controller can be quickly deployed on robots with different actuators and sensor payloads}. The flexibility of OpenSHC is demonstrated on the 30 degrees of freedom hexapod Bullet, analysing the energetic performance of various leg configurations, kinematic arrangements and gaits over different locomotion speeds. With OpenSHC being easily configured to different physical and locomotion specifications, a hardware-based parameter space search for optimal locomotion parameters is conducted. The experimental evaluation shows that the mammalian configuration offers lower power consumption across a range of step frequencies; with the insectoid configuration providing performance advantages at higher body velocities and increased stability at low step frequencies. OpenSHC is open-source and able to be configured for various number of joints and legs.
△ Less
Submitted 19 October, 2020; v1 submitted 8 June, 2020;
originally announced June 2020.