Increasing SAM Zero-Shot Performance on Multimodal Medical Images Using GPT-4 Generated Descriptive Prompts Without Human Annotation

no code implementations • 24 Feb 2024 • Zekun Jiang, Dongjie Cheng, Ziyuan Qin, Jun Gao, Qicheng Lao, Kang Li, Le Zhang

This study develops and evaluates a novel multimodal medical image zero-shot segmentation algorithm named Text-Visual-Prompt SAM (TV-SAM) without any manual annotations.

Descriptive Language Modelling +3

SAM on Medical Images: A Comprehensive Study on Three Prompt Modes

no code implementations • 28 Apr 2023 • Dongjie Cheng, Ziyuan Qin, Zekun Jiang, Shaoting Zhang, Qicheng Lao, Kang Li

As the first promptable foundation model for segmentation tasks, it was trained on a large dataset with an unprecedented number of images and annotations.

Image Segmentation Medical Image Segmentation +2