Research

Haptic Feedback for Motor Learning

Research Much like how a tennis or golf coach can grasp your arm and haptically show you how to swing your arms to execute a shot, haptic systems can be programmed to do the same. We investigate how humans learn from haptic feedback and design methods to intelligently deliver this instruction through robotic systems. Read More ›

Open Source Force Sensors for Minimally Invasive Surgical Robotics Research

Research Research into haptic feedback, data-driven indirect force sensing approaches, and surgical skill evaluation require accurate knowledge of tool-tissue interaction forces. However, such measurement tools are not available commercially, and are difficult to realize without specialized knowledge. Our group develops sensor designs that strike a balance between ease-of-manufacture, cost, size and accuracy, to help researchers achieve their vision, thereby helping to advance our field. Our force sensors use an array of miniature commercially available load cells to sense forces applied to the forcep jaws. The interface to different forcep jaws are compatible with different jaw geometries making the system customizable to different surgical applications. The range of the for sensor is 5N in axial compression, and tension and 3N in the positive and negative lateral directions. Read More ›

Vision-based Force Estimation and Haptic Feedback using Neural Networks

Research Forcep tip force sensing in robot-assisted minimally invasive surgery is challenging due to strict requirements for miniaturization, biocompatibility, and sterilizability. Indirect force estimation is a promising method to measure forces while circumventing these constraints. Much like how humans can estimate forces visually, neural networks can attempt to do something similar. However, there are concerns as to the generalizability of these methods as well as the relative importance of visual information compared to robot kinematic state information as inputs. We characterize the performance of vision-based neural networks with these considerations in mind and quantify the quality of the closed-loop haptic feedback they can provide to the operator. Read More ›

Learning Visual Force Estimation during Teleoperation of a Surgical Robot

Research Leading commercial robot-assisted minimally invasive surgery (RMIS) platforms such as the da Vinci Surgical System do not provide force feedback to the surgeon. Instead, surgeons rely on visual force estimation to judge the amount of force they apply to tissue. This is a difficult skill that takes a long time to master. Experienced surgeons often report being able to 'feel' tissue manipulation forces in their hands. Motivated by the need to accelerate the learning of visual force estimation in RMIS, we investigate the effects of training with force feedback on visual force estimation during teleoperated soft environment manipulation. Read More ›