Search Results for author:
Found 37 papers, 23 papers with code
OpenMEDLab: An Open-source Platform for Multi-modality Foundation Models in Medicine
The emerging trend of advancing generalist artificial intelligence, such as GPTv4 and Gemini, has reshaped the landscape of research (academia and industry) in machine learning and many other research areas.
OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM
Importantly, all images in this benchmark are sourced from authentic medical scenarios, ensuring alignment with the requirements of the medical field and suitability for evaluating LVLMs.
SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
We propose SPHINX-X, an extensive Multimodality Large Language Model (MLLM) series developed upon SPHINX.
Ranked #5 on
Video Question Answering
on MVBench
SegRap2023: A Benchmark of Organs-at-Risk and Gross Tumor Volume Segmentation for Radiotherapy Planning of Nasopharyngeal Carcinoma
The precise delineation of Gross Tumor Volumes (GTVs) and Organs-At-Risk (OARs) is crucial in radiation treatment, directly impacting patient prognosis.
Towards the Unification of Generative and Discriminative Visual Foundation Model: A Survey
The advent of foundation models, which are pre-trained on vast datasets, has ushered in a new era of computer vision, characterized by their robustness and remarkable zero-shot generalization capabilities.
Prompted Contextual Transformer for Incomplete-View CT Reconstruction
To enjoy the multi-setting synergy in a single model, we propose a novel Prompted Contextual Transformer (ProCT) for incomplete-view CT reconstruction.
Enhancing Medical Task Performance in GPT-4V: A Comprehensive Study on Prompt Engineering Strategies
OpenAI's latest large vision-language model (LVLM), GPT-4V(ision), has piqued considerable interest for its potential in medical applications.
SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million masks
Segment Anything Model (SAM) has achieved impressive results for natural image segmentation with input prompts such as points and bounding boxes.
SAM-Med3D
These issues can hardly be addressed by fine-tuning SAM on medical data because the original 2D structure of SAM neglects 3D spatial information.
A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentation
To address these questions, we introduce A-Eval, a benchmark for the cross-dataset Evaluation ('Eval') of Abdominal ('A') multi-organ segmentation.
SAM-Med2D
To bridge this gap, we introduce SAM-Med2D, the most comprehensive studies on applying SAM to medical 2D images.
Artifact Restoration in Histology Images with Diffusion Probabilistic Models
Histological whole slide images (WSIs) can be usually compromised by artifacts, such as tissue folding and bubbles, which will increase the examination difficulty for both pathologists and Computer-Aided Diagnosis (CAD) systems.
Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation
To make up for its deficiency when applying transfer learning to medical image segmentation, in this paper, we therefore propose a new Transferability Estimation (TE) method.
MedFMC: A Real-world Dataset and Benchmark For Foundation Model Adaptation in Medical Image Classification
Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications.
STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-training
However, the state-of-the-art models for medical image segmentation are still small-scale, with their parameters only in the tens of millions.
Learning with Explicit Shape Priors for Medical Image Segmentation
Hence, in our work, we proposed a novel shape prior module (SPM), which can explicitly introduce shape priors to promote the segmentation performance of UNet-based models.
Token Sparsification for Faster Medical Image Segmentation
To this end, we reformulate segmentation as a sparse encoding -> token completion -> dense decoding (SCD) pipeline.
Generative Model Based Noise Robust Training for Unsupervised Domain Adaptation
D-CFA minimizes the domain gap by augmenting the source data with distribution-sampled target features, and trains a noise-robust discriminative classifier by using target domain knowledge from the generative models.
FCN+: Global Receptive Convolution Makes FCN Great Again
The motivation of GRC is that different channels of a convolutional filter can have different grid sampling locations across the whole input feature map.
Neural Transformation Fields for Arbitrary-Styled Font Generation
Few-shot font generation (FFG), aiming at generating font images with a few samples, is an emerging topic in recent years due to the academic and commercial values.
Exploring Vanilla U-Net for Lesion Segmentation from Whole-body FDG-PET/CT Scans
The combination of PET-based metabolic and CT-based anatomic information can contribute to better tumor segmentation results.
An evaluation of U-Net in Renal Structure Segmentation
Renal structure segmentation from computed tomography angiography~(CTA) is essential for many computer-assisted renal cancer treatment applications.
Vision Transformer Adapter for Dense Predictions
This work investigates a simple yet powerful dense prediction task adapter for Vision Transformer (ViT).
Ranked #4 on
Semantic Segmentation
on PASCAL Context
StructToken : Rethinking Semantic Segmentation with Structural Prior
In previous deep-learning-based methods, semantic segmentation has been regarded as a static or dynamic per-pixel classification task, \textit{i. e.,} classify each pixel representation to a specific category.
Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentation
Masked Autoencoder (MAE) has recently been shown to be effective in pre-training Vision Transformers (ViT) for natural image analysis.
Dynamic Instance Domain Adaptation
In this paper, we address both single-source and multi-source UDA from a completely different perspective, which is to view each instance as a fine domain.
OpenKBP-Opt: An international and reproducible evaluation of 76 knowledge-based planning pipelines
The dose predictions were input to four optimization models to form 76 unique KBP pipelines that generated 7600 plans.
Group Shift Pointwise Convolution for Volumetric Medical Image Segmentation
Recent studies have witnessed the effectiveness of 3D convolutions on segmenting volumetric medical images.
A Novel Hybrid Convolutional Neural Network for Accurate Organ Segmentation in 3D Head and Neck CT Images
An essential step of RT planning is the accurate segmentation of various organs-at-risks (OARs) in HaN CT images.
Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognition
To this end, we propose an Attention-Driven Dynamic Graph Convolutional Network (ADD-GCN) to dynamically generate a specific graph for each image.
Ranked #22 on
Multi-Label Classification
on MS-COCO
MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response
Furthermore, we experiment the proposed method on an in-house, retrospective dataset of real-world non-small cell lung cancer patients under anti-PD-1 immunotherapy.
Ranked #1 on
Text-To-Speech Synthesis
on 20000 utterances
(using extra training data)
EfficientFCN: Holistically-guided Decoding for Semantic Segmentation
State-of-the-art semantic segmentation algorithms are mostly based on dilated Fully Convolutional Networks (dilatedFCN), which adopt dilated convolutions in the backbone networks to extract high-resolution feature maps for achieving high-performance segmentation performance.
Tensor Low-Rank Reconstruction for Semantic Segmentation
Then we use these rank-1 tensors to recover the high-rank context features through our proposed tensor reconstruction module (TRM).
Learning to Predict Context-adaptive Convolution for Semantic Segmentation
Long-range contextual information is essential for achieving high-performance semantic segmentation.
Dynamic Multi-Scale Filters for Semantic Segmentation
DMNet is composed of multiple Dynamic Convolutional Modules (DCMs) arranged in parallel, each of which exploits context-aware filters to estimate semantic representation for a specific scale.
Adaptive Pyramid Context Network for Semantic Segmentation
Recent studies witnessed that context features can significantly improve the performance of deep semantic segmentation networks.
Ranked #34 on
Thermal Image Segmentation
on MFN Dataset
Prostate Segmentation using 2D Bridged U-net
To address the aforementioned three problems, we propose and validate a deeper network that can fit medical image datasets that are usually small in the sample size.
