Precision is everything in surgery for esophageal, gastric, or lung cancer. University Medical Center Utrecht (UMC Utrecht) departments of cardiothoracic surgery and gastro-intestinal surgery have joined forces with medical technology company Surgical Reality to develop software that projects three-dimensional (3D) images of the surgical field directly onto the surgeon’s view during a robotic procedure. This technology could help surgeons navigate with greater confidence during complex procedures.
A digital map over the surgical field
The AugmentedSR project focuses on developing augmented reality (AR) software for use during minimally invasive robotic thoracic surgery. Augmented reality is a technology that superimposes digital information, such as a 3D reconstruction of organs, tumors, or blood vessels derived from CT imaging, as an overlay on the live endoscopic camera feed. This gives the surgeon additional anatomical context without leaving the surgical field.
The platform uses artificial intelligence (AI) to convert CT scans into a three-dimensional model. This model is then projected in real time onto the image displayed at the robotic console or laparoscopic workstation.
Clinical and industry expertise combined
UMC Utrecht serves as the academic clinical partner of Surgical Reality, a Dutch medical technology company specializing in advanced medical imaging for surgery. The collaboration brings together Surgical Reality’s software expertise and UMC Utrecht’s clinical experience in robotic surgery for cancers including esophageal and lung cancer.
“Robotic surgery already gives us a highly magnified view of the operative field. The next step is adding information from the patient’s scan, so we can see exactly where we are in relation to critical structures during the procedure. We would like to see beyond what we already see with our eyes. That is what this project is working towards.”
Co-funded by the European Union
The AugmentedSR project is co-funded by the European Union through the Kansen voor West III (KVW3) programme, a European Regional Development Fund (ERDF) initiative supporting innovation in the Utrecht region and beyond.
What is augmented reality in surgery?
Augmented reality (AR) in surgery is a technology that projects digital images, such as a 3D organ model based on CT scans, over the live camera feed during an operation. The surgeon receives additional visual information about the anatomy without interrupting the procedure.
What is the AugmentedSR project?
AugmentedSR is a research and development project by Surgical Reality and UMC Utrecht, focused on AI-powered augmented reality software for use in robotic thoracic surgery. The project is co-funded by the European Union through the Kansen voor West III programme.
Who is involved from UMC Utrecht?
UMC Utrecht is represented by Amir Sadeghi from the department of cardiothoracic surgery in collaboration with Jelle Ruurda from the department of gastro-intestinal surgery. UMC Utrecht acts as the academic clinical partner in this project.
What is Kansen voor West?
Kansen voor West is a European subsidy programme supporting innovative projects in the Dutch regions of Utrecht, North Holland, South Holland, Zeeland, and Flevoland, funded through the European Regional Development Fund (ERDF).
