Name: Neil Getty
Pronouns:
Biography:
Neil is a computational scientist at Argonne National Laboratory in the Data Science and Learning Division. His work focuses on developing AI methods for medical applications, including outcome and risk prediction from health record and medical images, as well as AI applied to minimally invasive robotic surgery.
Institution/Lab: Argonne National Laboratory
Website:
SRP Collaboration Topic/Title: Vision Language Action Models for Robotic Surgery
Field or research area: AI, Robotics, LLM, Medicine
Please select all the topical areas that apply to your project:
Computational Science Applications (i.e., bioscience, cosmology, chemistry, environmental science, nanotechnology, climate, etc.); Data Science (i.e., data analytics, data management & storage systems, visualization); Machine Learning and AI
Brief Abstract:
Robotic surgery presents many motivating challenges for computing research. Robotic surgery is an interface between surgeons and patients, much in the way motor vehicles are becoming less mechanic, and more of an interface between drivers and the road. In driving, optical and radar sensors coupled with automated warning, braking, and steering actions have dramatically increased motor-vehicle safety. We expect a similar development of technologies that prevent mistakes and improve outcomes in surgery. We are partnered with the Surgical Innovation and Training Lab at the University of Illinois at Chicago, with access to a robotic surgery research kit, expert annotated surgery videos, and medical expert collaborators. Our research efforts include instrument detection and segmentation, depth estimation, instrument tracking and kinematic estimation, and skill estimation applied to robotic surgery. We are particularly interested in exploring foundation models, vision language, and vision language action models for robotic surgery tasks.
Desired relevant skills, background, or interests:
Programming (python, pytorch, cv2), data, machine learning, deep learning, biomedicine, computer vision
Other comments:
Do any special requirements apply? Permanent Resident OK; International OK
Other, specify:
Keywords:
AI; Medicine; Generative Models; Computer Vision; Vision Language Models
Lightning Talk Title: AI For Robotic Surgery