4.6 Article Proceedings Paper

A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination

Journal

Publisher

SPRINGER
DOI: 10.1007/s00464-017-5821-5

Keywords

Proficiency; Graduate medical education; Clinical competence; Fundamentals of endoscopic; surgery; Task performance and analysis; Curriculum

Categories

Funding

  1. MGH Executive Committee on Teaching and Education
  2. National Institutes of Health National Institute of Diabetes and Digestive and Kidney Diseases (NIH NIDDK) [T32DK007754-16A1]
  3. Massachusetts General Hospital (MGH) Edward D. Churchill Research Fellowship

Ask authors/readers for more resources

Introduction The fundamentals of endoscopic surgery (FES) examination is a national test of knowledge and skill in flexible gastrointestinal endoscopy. The skill portion of the examination involves five tasks that assesses the following skills: scope navigation, loop reduction, mucosal inspection, retroflexion, and targeting. This project aimed to assess the efficacy of a proficiency-based virtual reality (VR) curriculum in preparing residents for the FES skills exam. Methods Experienced (>100 career colonoscopies) and inexperienced endoscopists (< 50 career colonoscopies) were recruited to participate. Six VR modules were identified as reflecting the skills tested in the exam. All participants were asked to perform each of the selected modules twice, and median performance was compared between the two groups. Inexperienced endoscopists were subsequently randomized in matched pairs into a repetition (10 repetitions of each task) or proficiency curriculum. After completion of the respective curriculum, FES scores and pass rates were compared to national data and historical institutional control data (endoscopy-rotation training alone). Results Five experienced endoscopists and twenty-three inexperienced endoscopists participated. Construct valid metrics were identified for six modules and proficiency benchmarks were set at the median performance of experienced endoscopists. FES scores of inexperienced endoscopists in the proficiency group had significantly higher FES scores (530 +/- 86) versus historical control (386.7 +/- 92.2, p = 0.0003) and higher pass rate (proficiency: 100%, historical control 61.5%, p = 0.01). Conclusion Trainee engagement in a VR curriculum yields superior FES performance compared to an endoscopy rotation alone. Compared to the 2012-2016 national resident pass rate of 80, 100% of trainees in a proficiency-based curriculum passed the FES manual skills examination.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Surgery

Open innovation facilitates department-wide engagement in quality improvement: experience from the Massachusetts General Hospital

Yanik J. Bababekov, Sahael M. Stapleton, Daniel A. Hashimoto, Elan R. Witkowski, Alex B. Haynes, Allan M. Goldstein, John T. Mullen, Eric M. Isselbacher, Keith D. Lillemoe, David C. Chang

Summary: A web-enabled open innovation contest effectively engaged faculty, residents, and other critical role groups in quality improvement, while also helping leadership reaffirm a positive culture of inclusivity, maintaining an open-door policy, and democratically vetting and prioritizing solutions for quality improvement.

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES (2021)

Review Surgery

Machine Learning for Surgical Phase Recognition A Systematic Review

Carly R. Garrow, Karl-Friedrich Kowalewski, Linhong Li, Martin Wagner, Mona W. Schmidt, Sandy Engelhardt, Daniel A. Hashimoto, Hannes G. Kenngott, Sebastian Bodenstedt, Stefanie Speidel, Beat P. Mueller-Stich, Felix Nickel

Summary: This study provides an overview of the use of ML models and data streams in automated surgical phase recognition. Through screening 2254 articles, the commonly used ML models and data sources were identified. The results demonstrate that ML can achieve high accuracy in surgical phase recognition.

ANNALS OF SURGERY (2021)

Article Surgery

Computer vision in surgery

Thomas M. Ward, Pietro Mascagni, Yutong Ban, Guy Rosman, Nicolas Padoy, Ozanan Meireles, Daniel A. Hashimoto

Summary: In recent years, rapid advancements in the fields of computer vision and artificial intelligence, fueled by deep learning technology, have led to widespread applications in intraoperative video analysis. The development of deep neural networks has enabled computers to accurately understand images, driving further applications of computer vision in surgical video analysis, improving the accuracy of identifying surgical phases and instruments.

SURGERY (2021)

Article Education, Scientific Disciplines

The Surgical Program in Innovation (SPIN): A Design and Prototyping Curriculum for Surgical Trainees

Daniel J. Wong, David Miranda-Nieves, Prathima Nandivada, Madhukar S. Patel, Daniel A. Hashimoto, Daniel O. Kent, Jose Gomez-Marquez, Samuel J. Lin, Henry J. Feldman, Elliot L. Chaikof

Summary: Innovative education is lacking in health professions training, but the Surgical Program in Innovation (SPIN) aims to address this gap by teaching surgical trainees the basics of innovation through a workshop-based curriculum. Participants collaborate to identify unmet clinical needs, design and fabricate novel devices, and pitch their products, resulting in increased confidence in problem solving and commercialization steps. The authors plan to expand SPIN to other specialties and assess its impact on fostering innovation and collaboration among participants.

ACADEMIC MEDICINE (2021)

Editorial Material Surgery

Surgeons and Machines Can Learn From Operative Video Will the System Let Them?

Daniel A. Hashimoto

ANNALS OF SURGERY (2021)

Review Urology & Nephrology

Ethical implications of AI in robotic surgical training: A Delphi consensus statement

Justin W. Collins, Hani J. Marcus, Ahmed Ghazi, Ashwin Sridhar, Daniel Hashimoto, Gregory Hager, Alberto Arezzo, Pierre Jannin, Lena Maier-Hein, Keno Marz, Pietro Valdastri, Kensaku Mori, Daniel Elson, Stamatia Giannarou, Mark Slack, Luke Hares, Yanick Beaulieu, Jeff Levy, Guy Laplante, Arvind Ramadorai, Anthony Jarc, Ben Andrews, Pablo Garcia, Huzefa Neemuchwala, Alina Andrusaite, Tom Kimpe, David Hawkes, John D. Kelly, Danail Stoyanov

Summary: This study provides ethical guidance on developing narrow AI applications for surgical training by seeking consensus from an expert committee. The results show consensus in multiple areas, including data protection and privacy, reproducibility and transparency, predictive analytics, inherent biases, and areas of training most likely to benefit from AI. This provides an ethical foundation for launching narrow AI applications in surgical training.

EUROPEAN UROLOGY FOCUS (2022)

Review Cardiac & Cardiovascular Systems

A scoping review of artificial intelligence applications in thoracic surgery

Kenneth P. Seastedt, Dana Moukheiber, Saurabh A. Mahindre, Chaitanya Thammineni, Darin T. Rosen, Ammara A. Watkins, Daniel A. Hashimoto, Chuong D. Hoang, Jacques Kpodonu, Leo A. Celi

Summary: Machine learning has great potential in thoracic surgery, but also faces challenges. The transparency of data and algorithm design, as well as the systemic bias on which models are dependent, remain issues to be addressed. Although not widely used yet in thoracic surgery, it is essential for thoracic surgeons to be at the forefront in the safe introduction of machine learning to the clinic and operating room.

EUROPEAN JOURNAL OF CARDIO-THORACIC SURGERY (2022)

Article Computer Science, Artificial Intelligence

Surgical data science-from concepts toward clinical translation

Lena Maier-Hein, Matthias Eisenmann, Duygu Sarikaya, Keno Maerz, Toby Collins, Anand Malpani, Johannes Fallert, Hubertus Feussner, Stamatia Giannarou, Pietro Mascagni, Hirenkumar Nakawala, Adrian Park, Carla Pugh, Danail Stoyanov, Swaroop S. Vedula, Kevin Cleary, Gabor Fichtinger, Germain Forestier, Bernard Gibaud, Teodor Grantcharov, Makoto Hashizume, Doreen Heckmann-Noetzel, Hannes G. Kenngott, Ron Kikinis, Lars Muendermann, Nassir Navab, Sinan Onogur, Tobias Ross, Raphael Sznitman, Russell H. Taylor, Minu D. Tizabi, Martin Wagner, Gregory D. Hager, Thomas Neumuth, Nicolas Padoy, Justin Collins, Ines Gockel, Jan Goedeke, Daniel A. Hashimoto, Luc Joyeux, Kyle Lam, Daniel R. Leff, Amin Madani, Hani J. Marcus, Ozanan Meireles, Alexander Seitel, Dogu Teber, Frank Ueckert, Beat P. Mueller-Stich, Pierre Jannin, Stefanie Speidel

Summary: Surgical Data Science is a new research field aiming to improve interventional healthcare quality through data analysis, yet lacks translational success stories in surgery. An international workshop reviewed current practice, key achievements, infrastructure, data annotation and sharing, and data analytics standards and tools relevant to the field.

MEDICAL IMAGE ANALYSIS (2022)

Article Surgery

Executive summary of the artificial intelligence in surgery series

Tyler J. Loftus, Alexander P. J. Vlaar, Andrew J. Hung, Azra Bihorac, Bradley M. Dennis, Catherine Juillard, Daniel A. Hashimoto, Haytham M. A. Kaafarani, Patrick J. Tighe, Paul C. Kuo, Shuhei Miyashita, Steven D. Wexner, Kevin E. Behrns

Summary: As opportunities for artificial intelligence to augment surgical care expand, there is both enthusiasm and concern regarding its safety and efficacy. Surgeons and surgical data scientists must understand the state-of-the-art, recognize gaps in knowledge and technology, and critically evaluate the published literature.

SURGERY (2022)

Article Surgery

Development and validity evidence of an objective structured assessment of technical skills score for minimally invasive linear-stapled, hand-sewn intestinal anastomoses: the A-OSATS score

Mona W. Schmidt, Caelan M. Haney, Karl-Friedrich Kowalewski, Vasile V. Bintintan, Mohammed Abu Hilal, Alberto Arezzo, Marcus Bahra, Marc G. Besselink, Matthias Biebl, Luigi Boni, Michele Diana, Jan H. Egberts, Lars Fischer, Nader Francis, Daniel A. Hashimoto, Daniel Perez, Marlies Schijven, Moritz Schmelzle, Marek Soltes, Lee Swanstrom, Thilo Welsch, Beat P. Muller-Stich, Felix Nickel

Summary: This study developed a reliable assessment score for hand-sewn closure of intestinal anastomoses based on international expert consensus. The score showed excellent reliability and discriminated well between different levels of expertise, providing a promising tool for evaluating surgical skills.

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES (2022)

Article Surgery

Artificial intelligence prediction of cholecystectomy operative course from automated identification of gallbladder inflammation

Thomas M. Ward, Daniel A. Hashimoto, Yutong Ban, Guy Rosman, Ozanan R. Meireles

Summary: The study found that an AI model can accurately identify the degree of gallbladder inflammation, which has an impact on the intra-operative course. The automated assessment system can be used for optimizing the workflow in the operating room and providing targeted feedback to surgeons and residents, accelerating the acquisition of operative skills.

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES (2022)

Article Surgery

Transfer of virtual reality endoscopy training to live animal colonoscopy: a randomized control trial of proficiency vs. repetition-based training

Douglas J. Cassidy, Taylor M. Coe, Kristen M. Jogerst, Sophia K. McKinley, Naomi M. Sell, Michael Sampson, Yoon Soo Park, Emil Petrusa, Robert N. Goldstone, Daniel A. Hashimoto, Denise W. Gee

Summary: This study evaluated the impact of virtual reality endoscopy training on live porcine endoscopy performance and compared the effectiveness of proficiency-based and repetition-based training curricula. The results showed that virtual reality training improved both upper and lower endoscopy performance and manual skills. The type of training curriculum did not significantly affect exam performance, but proficiency-based training was more time-effective and provided a structured approach to preparation.

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES (2022)

Review Chemistry, Analytical

Using Artificial Intelligence-Enhanced Sensing and Wearable Technology in Sports Medicine and Performance Optimisation

Swathikan Chidambaram, Yathukulan Maheswaran, Kian Patel, Viknesh Sounderajah, Daniel A. Hashimoto, Kenneth Patrick Seastedt, Alison H. McGregor, Sheraz R. Markar, Ara Darzi

Summary: Wearable technologies are small electronic and mobile devices that can be worn on the body and have sensors to collect data, which can be processed and analyzed by artificial intelligence systems. The use of AI in sports such as basketball, baseball, and motor racing has shown improvements in athletic performance. However, there are challenges in adopting AI technologies in sports medicine.

SENSORS (2022)

Review Health Care Sciences & Services

Computer vision in surgery: from potential to clinical value

Pietro Mascagni, Deepak Alapatt, Luca Sestini, Maria S. Altieri, Amin Madani, Yusuke Watanabe, Adnan Alseidi, Jay A. Redan, Sergio Alfieri, Guido Costamagna, Ivo Boskoski, Nicolas Padoy, Daniel A. Hashimoto

Summary: Computer vision, the application of algorithms to analyze and interpret visual data, has become a critical technology in studying the intraoperative phase of care, supporting safer surgery, and expanding access to surgical care. However, there are currently no widely used computer vision tools for diagnostic or therapeutic applications in surgery.

NPJ DIGITAL MEDICINE (2022)

Article Surgery

Artificial Intelligence for Intraoperative Guidance Using Semantic Segmentation to Identify Surgical Anatomy During Laparoscopic Cholecystectomy

Amin Madani, Babak Namazi, Maria S. Altieri, Daniel A. Hashimoto, Angela Maria Rivera, Philip H. Pucher, Allison Navarrete-Welton, Ganesh Sankaranarayanan, L. Michael Brunt, Allan Okrainec, Adnan Alseidi

Summary: This study developed and evaluated artificial intelligence models that can identify safe and dangerous zones, as well as anatomical landmarks, during laparoscopic cholecystectomy (LC). The models showed promising results in accurately identifying these areas, indicating the potential for real-time guidance in surgery to minimize adverse events.

ANNALS OF SURGERY (2022)

No Data Available