Real-time Surgical Instrument Segmentation in Video Using Point Tracking and Segment Anything

no code implementations • 12 Mar 2024 • Zijian Wu, Adam Schmidt, Peter Kazanzides, Septimiu E. Salcudean

Inspired by this progress, we present a novel framework that combines an online point tracker with a lightweight SAM model that is fine-tuned for surgical instrument segmentation.

Point Tracking Segmentation +3

PIPsUS: Self-Supervised Dense Point Tracking in Ultrasound

no code implementations • 8 Mar 2024 • Wanwen Chen, Adam Schmidt, Eitan Prisman, Septimiu E Salcudean

Finding point-level correspondences is a fundamental problem in ultrasound (US), since it can enable US landmark tracking for intraoperative image guidance in different surgeries, including head and neck.

Data Augmentation Landmark Tracking +2

Tracking and Mapping in Medical Computer Vision: A Review

no code implementations • 17 Oct 2023 • Adam Schmidt, Omid Mohareri, Simon DiMaio, Michael C. Yip, Septimiu E. Salcudean

In this review, we provide an update to the field of camera-based tracking and scene mapping in surgery and diagnostics in medical computer vision.

Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mapping

no code implementations • 28 Sep 2023 • Adam Schmidt, Omid Mohareri, Simon DiMaio, Septimiu E. Salcudean

STIR comprises hundreds of stereo video clips in both in-vivo and ex-vivo scenes with start and end points labelled in the IR spectrum.

SENDD: Sparse Efficient Neural Depth and Deformation for Tissue Tracking

no code implementations • 10 May 2023 • Adam Schmidt, Omid Mohareri, Simon DiMaio, Septimiu E. Salcudean

SENDD enables multiple downstream applications that require estimation of 3D motion in stereo endoscopy.

Motion Estimation