Robotics: Science and Systems XIX

Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approach

Max Bajracharya, James Borders, Richard Cheng, Dan Helmick, Lukas Kaul, Dan Kruse, John Leichty, Jeremy Ma, Carolyn Matl, Frank Michel, Chavdar Papazov, Josh Petersen, Krishna Shankar, Mark Tjersland


We present our general-purpose mobile manipulation system consisting of a custom robot platform and key algorithms spanning perception and planning. To extensively test the system in the wild and benchmark its performance, we choose a grocery shopping scenario in an actual, unmodified grocery store. We derive key performance metrics from detailed robot log data collected during six week-long field tests, spread across 18 months. These objective metrics, gained from complex yet repeatable tests, drive the direction of our research efforts and let us continuously improve our system’s performance. We find that thorough end-to-end system-level testing of a complex mobile manipulation system can serve as a reality-check for state-of-the-art methods in robotics. This effectively grounds robotics research efforts in real world needs and challenges, which we deem highly useful for the advancement of the field. To this end, we share our key insights and takeaways to inspire and accelerate similar system-level research projects.



    AUTHOR    = {Max Bajracharya AND James Borders AND Richard Cheng AND Dan Helmick AND Lukas Kaul AND Dan Kruse AND John Leichty AND Jeremy Ma AND Carolyn Matl AND Frank Michel AND Chavdar Papazov AND Josh Petersen AND Krishna Shankar AND Mark Tjersland}, 
    TITLE     = {{Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approach}}, 
    BOOKTITLE = {Proceedings of Robotics: Science and Systems}, 
    YEAR      = {2023}, 
    ADDRESS   = {Daegu, Republic of Korea}, 
    MONTH     = {July}, 
    DOI       = {10.15607/RSS.2023.XIX.055}