Interactive Imitation Learning in Robotics: A Survey

AI-generated keywords: Interactive Imitation Learning Human-Robot Interaction Reinforcement Learning Real-World Robotic Applications Function Approximators

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Interactive Imitation Learning (IIL) is a subfield of Imitation Learning (IL) in robotics that involves providing intermittent human feedback during robot execution to improve its behavior online.
  • IIL has emerged as a promising data-driven alternative for solving complex robotic tasks due to its data efficiency and robustness.
  • Lack of clarity and unity in terminology, structure, and applicability in the literature has slowed down its development and research progress.
  • A comprehensive survey of the field has been presented to unify and structure it while raising awareness of its potential.
  • Relevant works in IIL have been organized based on human-robot interaction types, interfaces for providing feedback, models learned from feedback and function approximators, user experience regarding the learning process, applications, and benchmarks.
  • Similarities and differences between IIL and Reinforcement Learning (RL) have been analyzed while discussing their implications, limitations, and promising future areas of research.
  • The authors focus particularly on real-world robotic applications while discussing their implications, limitations, and promising future areas of research.
  • This survey aims to facilitate research in IIL by lowering entry barriers for new practitioners while highlighting what has been accomplished so far and what open research questions remain.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Carlos Celemin, Rodrigo Pérez-Dattari, Eugenio Chisari, Giovanni Franzese, Leandro de Souza Rosa, Ravi Prakash, Zlatan Ajanović, Marta Ferraz, Abhinav Valada, Jens Kober

License: CC BY-NC-ND 4.0

Abstract: Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot's behavior. In recent years, IIL has increasingly started to carve out its own space as a promising data-driven alternative for solving complex robotic tasks. The advantages of IIL are its data-efficient, as the human feedback guides the robot directly towards an improved behavior, and its robustness, as the distribution mismatch between the teacher and learner trajectories is minimized by providing feedback directly over the learner's trajectories. Nevertheless, despite the opportunities that IIL presents, its terminology, structure, and applicability are not clear nor unified in the literature, slowing down its development and, therefore, the research of innovative formulations and discoveries. In this article, we attempt to facilitate research in IIL and lower entry barriers for new practitioners by providing a survey of the field that unifies and structures it. In addition, we aim to raise awareness of its potential, what has been accomplished and what are still open research questions. We organize the most relevant works in IIL in terms of human-robot interaction (i.e., types of feedback), interfaces (i.e., means of providing feedback), learning (i.e., models learned from feedback and function approximators), user experience (i.e., human perception about the learning process), applications, and benchmarks. Furthermore, we analyze similarities and differences between IIL and RL, providing a discussion on how the concepts offline, online, off-policy and on-policy learning should be transferred to IIL from the RL literature. We particularly focus on robotic applications in the real world and discuss their implications, limitations, and promising future areas of research.

Submitted to arXiv on 31 Oct. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2211.00600v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

Interactive Imitation Learning (IIL) is a subfield of Imitation Learning (IL) in robotics that involves providing intermittent human feedback during robot execution to improve its behavior online. In recent years, IIL has emerged as a promising data-driven alternative for solving complex robotic tasks due to its data efficiency and robustness. To address the lack of clarity and unity in terminology, structure, and applicability in the literature which has slowed down its development and research progress, this article presents a comprehensive survey of the field that unifies and structures it while raising awareness of its potential. The authors organize relevant works in IIL based on human-robot interaction types, interfaces for providing feedback, models learned from feedback and function approximators, user experience regarding the learning process, applications, and benchmarks. Additionally, they analyze similarities and differences between IIL and Reinforcement Learning (RL), discussing how concepts such as offline/online learning or off-policy/on-policy learning should be transferred from RL literature to IIL. The authors focus particularly on real-world robotic applications while discussing their implications, limitations, and promising future areas of research. This survey aims to facilitate research in IIL by lowering entry barriers for new practitioners while highlighting what has been accomplished so far and what open research questions remain. By doing so, it provides an essential reference point for researchers interested in exploring this exciting field's potential further.
Created on 18 Apr. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.