Immersive Interaction

The aim of this research programme is to create continuum robot systems, operated or monitored by a human user through an immersive interface. These envisioned systems will reach the unreachable in a non-destructive, minimally-invasive manner, and perform operations and manipulate objects with unprecedented accuracy and dexterity. The research funding for this programme is instrumental to achieving this goal, as it provides infrastructure for developing and manufacturing continuum robot technology (rapid prototyping, motors, motion control boards), sensing technology (fiber Bragg grating, force/torque, electro-magnetic tracking), and devices for human-robot interaction (haptic input devices, 3D visualization).

The research will have a direct impact on service robotics, particularly in healthcare and in maintenance, repair, and operations. For instance, thanks to their small size, continuum robots will allow clinicians to practice personalized medicine, delivering better care at a lower cost.

Immersive Interaction

Scientific Questions

  1. How can we effectively control continuum robots and leverage their embodied intelligence, while interacting with the environment?
  2. How can we interact with continuum robots and perceive feedback from robots, at varying levels of autonomy?

Research Pillar 1: Create Continuum Robot Systems

This technology development pillar aims to investigate and build systems of particularly small but long continuum robots, i.e. high diameter to length ratios, which are able to manoeuvre and manipulate in constrained and tortuous environments. The main challenge lies in the contradictory requirements of self-retainment and compliance over the full length. Based on our experience in mechatronics and preliminary results, we will conceive features such as self-stiffening through material composition, bracing components, and collaborative joining mechanisms. 3D printing from multiple materials and integration of functional parts as well as sensors are key enabling methods for the next generation of continuum robot systems and part of the requested infrastructure.

Research Pillar 2: Sense and Control Robot’s Morphology

In robotics, the environment used to be conceived as “in the way,” such that any contact of the robot with anything other than the manipulated object was considered a “collision” and was to be strictly avoided. In contrast, continuum robotics research considers the environment as an important tool for achieving task goals. The environment might even be considered as part of the robot’s morphology. To enable this view of robots acting with the environment, rather than in the environment, continuum robots are designed to accommodate contact-rich interactions by relying on underactuated and inherently compliant designs. This paradigm shift necessitates the development of novel approaches to the sense-relevant aspects of the robot’s morphology that are in contact with the environment to support suitable methods for motion planning and control.

Research Pillar 3: Engage with Human Operators

Thanks to their compliance, continuum robots are inherently safe when in direct contact with or in proximity to humans. As their structure is flexible and continuously bending, with many degrees of freedom, the control input to the robot and the resulting shape cannot be mentally related by the operator. Additionally, they are anticipated to be deployed insitu, such that the operator loses direct sight of the robot. This research pillar aims to design an immersive human-robot interface for continuum robot systems to enable intuitive interaction and collaborative manipulation. To allow for different levels of autonomy, ranging from teleoperation over task autonomy to full automation, we will investigate methods to perceive, interpret, reason, and act on a situation.

Funding

  • Canada Foundation for Innovation, John R. Evans Leaders Fund
  • Ontario Research Fund, Research Infrastructure

Publications

Publication Image
MoSS - Monocular Shape Sensing for Continuum Robots.

Chengnan Shentu, Enxu Li, Chaojun Chen, Puspita Triana Dewi, David B. Lindell, Jessica Burgner-Kahrs

IEEE Robotics and Automation Letters, 9(2):1524 - 1531, 2024.

Publication Image
Open Continuum Robotics - One Actuation Module to Create them All

Reinhard M. Grassmann, Chengnan Shentu, Taqi Hamoda, Puspita Triana Dewi, Jessica Burgner-Kahrs

Frontiers in Robotics and AI, 11, 2024.

Publication Image
Universal-jointed Tendon-driven Continuum Robot - Design, Kinematic Modeling, and Locomotion in Narrow Tubes

Chengnan Shentu, Jessica Burgner-Kahrs

40th Anniversary of the IEEE International Conference on Robotics and Automation, 2024.

Publication Image
Space-Time Continuum - Continuous Shape and Time State Estimation for Flexible Robots

Spencer Teetaert, Sven Lilge, Jessica Burgner-Kahrs, Timothy D. Barfoot

40th Anniversary of the IEEE International Conference on Robotics and Automation, 2024.

Publication Image
Towards Contact-Aided Motion Planning for Tendon-Driven Continuum Robots

Priyanka Rao, Oren Salzman, Jessica Burgner-Kahrs

IEEE Robotics & Automation Letters, 9(5):4687 - 4694, 2024.

Publication Image
A Lightweight Modular Segment Design for Tendon-Driven Continuum Robots with Pre-Programmable Stiffness

Puspita Triana Dewi, Priyanka Rao, Jessica Burgner-Kahrs

IEEE International Conference on Soft Robotics, 2024.

Publication Image
FAS - A Fully Actuated Segment for Tendon-Driven Continuum Robots

Reinhard Grassmann, Priyanka Rao, Quentin Peyron, Jessica Burgner-Kahrs

Frontiers in Robotics and AI, 9:873446 (19 pages), 2022.

Publication Image
Cooperative control of dual-arm concentric tube continuum robots

Hanna J. Zhang, Sven Lilge, M. Taha Chikhaoui, Jessica Burgner-Kahrs

International Conference on Manipulation, Automation and Robotics at Small Scales, 2022.

Publication Image
Learning-based Inverse Kinematics from Shape as Input for Concentric Tube Continuum Robots

Nan Liang, Reinhard M Grassmann, Jessica Burgner-Kahrs

IEEE International Conference on Robotics and Automation (ICRA), 2021.