Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning

2 code implementations • 12 Oct 2022 • Fuying Wang, Yuyin Zhou, Shujun Wang, Varut Vardhanabhuti, Lequan Yu

In this paper, we present a novel Multi-Granularity Cross-modal Alignment (MGCA) framework for generalized medical visual representation learning by harnessing the naturally exhibited semantic correspondences between medical image and radiology reports at three different levels, i. e., pathological region-level, instance-level, and disease-level.

Contrastive Learning Image Classification +4