# HAI Seminar: Human Skill Augmentation in Robot-Assisted Surgery Source: https://www.youtube.com/watch?v=gnDNGHCquzs Recap page: https://rapidrecap.app/video/gnDNGHCquzs Generated: 2026-01-22T18:40:29.361+00:00 --- ## Quick Overview The research demonstrates that incorporating force information into autonomous robotic surgery systems significantly improves performance, making them 3 times more successful and 110% gentler than force-agnostic systems, while also showing better generalization to unseen tissue samples. **Key Points:** - Force-aware autonomous systems are 3 times more successful than force-agnostic systems in tissue retraction tasks (76% vs 26% success rate in 50 rollouts). - The force policy applies 62% less force on average during tissue interaction compared to the no-force policy. - The force policy also proves more gentle in interactions with unseen tissue samples, as evidenced by force analysis histograms showing smaller applied forces. - The system uses an Action Chunking with Transformers (ACT) imitation learning architecture, trained on 60 human demonstrations. - The multi-camera, multi-view system, featuring an adaptive stereo camera baseline, improves depth perception and training effectiveness compared to single-view systems. - The overall goal is to move surgical robotics beyond imitating human techniques to leverage unique robotic capabilities for improved patient outcomes. ![Screenshot at 08:09: The slide detailing the robot's unique capabilities, listing them as having more than two arms, focusing on multiple locations simultaneously, having more than one pair of eyes, and adjustable inter-pupillary distance, which motivates the move towards multi-arm parallelism and adaptive vision systems.](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-08-09.jpg) **Context:** This presentation by Alaa Eldin Abdelaal focuses on augmenting human skill in robot-assisted surgery (RAS) by developing force-aware autonomous systems. The context is set against the backdrop of high rates of surgical errors and the unmet need for more procedures globally. The speaker contrasts traditional open surgery with minimally invasive surgery (MIS) and highlights the limitations of current 4-DOF endoscope control, arguing that robots should leverage unique capabilities like multiple arms and adjustable stereo vision rather than simply mimicking human actions. ## Detailed Analysis The presentation argues that current robotic surgery (RAS) practices often merely replicate open surgery through smaller incisions, failing to exploit unique robotic capabilities. The speaker outlines the research mission: Human Skill Augmentation focusing on Skill Acquisition and Task Execution. The talk highlights critical issues in surgery, such as medical errors being the third leading cause of death in the US, and notes that 50% of surgical complications are avoidable. The speaker then introduces the concept of Robot-Assisted Surgery (RAS) paradigms, contrasting open surgery (direct human-tissue interaction) with Minimally Invasive Surgery (MIS) (surgeon controlling instruments via camera). RAS, exemplified by the da Vinci system, uses multiple robotic arms but still largely imitates traditional surgical movements. A key observation is that current RAS often ignores the robot's unique capabilities, such as having more than two arms, focusing on multiple locations simultaneously, and having adjustable stereo vision (interpupillary distance). The research aims to create force-aware autonomous systems to address this. The team developed an imitation learning architecture called Action Chunking with Transformers (ACT), trained on kinematic, vision, and force data from human demonstrations. A key application studied is autonomous tissue retraction. Results show that the force-aware policy is 3 times more successful (76% vs 26%) and applies 110% less force on average than the no-force policy, demonstrating gentler interaction and better generalization to unseen tissue samples. The speaker also discusses the potential impact of multi-robot systems and adaptive camera baselines, concluding that autonomous systems do not need to imitate humans and can achieve superior, non-human-like performance. ### Introduction - Highlighting the prevalence of surgical errors (250,000 deaths/year in US) and the unmet need for procedures due to surgeon shortage; current RAS often mimics open surgery, ignoring robotic advantages. ### Research Mission - Focuses on Human Skill Augmentation through Skill Acquisition (improving motor skill learning) and Task Execution (designing autonomous systems for repetitive tasks). ### Robot's Unique Capabilities - Robots possess capabilities humans lack, including more than two arms, simultaneous focus on multiple locations, multiple views, and adjustable inter-pupillary distance. ### Force-Aware Autonomous Systems in RAS - Existing systems are force-agnostic, but different tissues have different stiffness levels, necessitating force awareness to avoid tissue damage (applying too little force hinders tasks, too much causes damage). ### Approach for Tissue Retraction - Used Imitation Learning Architecture (ACT) fed with kinematic, vision, and force data from 60 human demonstrations, training two policies: 'force policy' (using force data) and 'no-force policy'. ### Parallelism in Multi-Throw Suturing (Ongoing Work) - Explores automating one robotic arm to work in parallel with human-teleoperated arms, suggesting a shift from sequential to parallel execution models (HCSM). ### Potential Impact & Future Work - Autonomous systems can revolutionize surgery by leveraging unique capabilities (like multi-arm control) and developing adaptive stereo cameras, moving beyond human imitation. ![Screenshot at 00:00: Presentation title slide showing the speaker, Alaa Eldin Abdelaal, and the topic 'Assisted Surgery'.](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-00-00.jpg) ![Screenshot at 00:10: Slide detailing the introduction statistics: 230 million procedures worldwide per year, 250,000 deaths/year from medical errors in the US, 40% of errors in the OR, and 50% of complications are avoidable.](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-00-10.jpg) ![Screenshot at 01:17: Slide summarizing the research mission: Human Skill Augmentation focusing on Skill Acquisition and Task Execution, aiming to solve problems in robot-assisted surgery.](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-01-17.jpg) ![Screenshot at 02:42: Comparison diagram showing Open Surgery \(direct surgeon-patient interaction\) versus Minimally Invasive Surgery \(MIS\) \(surgeon controls instrument/camera via small incisions\).](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-02-42.jpg) ![Screenshot at 03:18: Slide introducing Robot-Assisted Surgery \(RAS\) with a video demonstration of the da Vinci system, noting 2,500,000 RAS procedures in 2024 using this system alone.](https://ss.rapidrecap.app/screens/gnDNGHCquzs/00-03-18.jpg)