Robotics: Science and Systems I

Efficient Exploration With Latent Structure

Bethany R. Leffler, Michael L. Littman, Alexander L. Strehl, Thomas J. Walsh

Abstract: When interacting with a new environment, a robot can improve its online performance by efficiently exploring the effects of its actions. The efficiency of exploration can be expanded significantly by modeling and using latent structure to generalize experiences. We provide a theoretical development of the problem of exploration with latent structure, analyze several algorithms and prove matching lower bounds. We demonstrate our algorithmic ideas on a simple robot car repeatedly traversing a path with two different surface properties.



    AUTHOR    = {Bethany R. Leffler and Michael L. Littman and 
                 Alexander L. Strehl and Thomas J. Walsh},
    TITLE     = {Efficient Exploration With Latent Structure},
    BOOKTITLE = {Proceedings of Robotics: Science and Systems},
    YEAR      = {2005},
    ADDRESS   = {Cambridge, USA},
    MONTH     = {June},
    DOI       = {10.15607/RSS.2005.I.011}