User-customizable Shared Control for Robot Teleoperation via Virtual Reality

Abstract

Shared control can ease and enhance a human operator’s ability to teleoperate robots, particularly for intricate tasks demanding fine control over multiple degrees of freedom. However, the arbitration process dictating how much autonomous assistance to administer in shared control can confuse novice operators and impede their understanding of the robot’s behavior. To overcome these adverse side-effects, we propose a novel formulation of shared control that enables operators to tailor the arbitration to their unique capabilities and preferences. Unlike prior approaches to “customizable” shared control where users could indirectly modify the latent parameters of the arbitration function by issuing a feedback command, we instead make these parameters observable and directly editable via a virtual reality (VR) interface. We present our user-customizable shared control method for a teleoperation task in SE(3), known as the buzz wire game. A user study is conducted with participants teleoperating a robotic arm in VR to complete the game. The experiment spanned two weeks per subject to investigate longitudinal trends. Our findings reveal that users allowed to interactively tune the arbitration parameters across trials generalize well to adaptations in the task, exhibiting improvements in precision and fluency over direct teleoperation and conventional shared control.

Publication
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Rui Luo
Rui Luo
PhD Alumnus
Mark Zolotas
Mark Zolotas
Former Postdoc
Drake Moore
Drake Moore
PhD Student
Taskin Padir
Taskin Padir
Professor, Principal Investigator