Search Results for author: Chaoyi Zhang

Found 38 papers, 17 papers with code

Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images

no code implementations13 Mar 2024 Tiange Xiang, Yixiao Zhang, Yongyi Lu, Alan Yuille, Chaoyi Zhang, Weidong Cai, Zongwei Zhou

To this end, we propose a Simple Space-Aware Memory Matrix for In-painting and Detecting anomalies from radiography images (abbreviated as SimSID).

Anatomy Image Reconstruction +1

MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning

no code implementations29 Nov 2023 Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, JianFeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang

We present MM-Narrator, a novel system leveraging GPT-4 with multimodal in-context learning for the generation of audio descriptions (AD).

In-Context Learning Text Generation

Exploring Annotation-free Image Captioning with Retrieval-augmented Pseudo Sentence Generation

1 code implementation27 Jul 2023 Zhiyuan Li, Dongnan Liu, Heng Wang, Chaoyi Zhang, Weidong Cai

We further show that with a simple extension, the generated pseudo sentences can be deployed as weak supervision to boost the 1% semi-supervised image caption benchmark up to 93. 4 CIDEr score (+8. 9) which showcases the versatility and effectiveness of our approach.

Image Captioning Model Optimization +2

TractCloud: Registration-free tractography parcellation with a novel local-global streamline point cloud representation

no code implementations18 Jul 2023 Tengfei Xue, Yuqian Chen, Chaoyi Zhang, Alexandra J. Golby, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

TractCloud achieves efficient and consistent whole-brain white matter parcellation across the lifespan (from neonates to elderly subjects, including brain tumor patients) without the need for registration.

Anatomy

TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance

no code implementations8 Jul 2023 Yuqian Chen, Leo R. Zekelman, Chaoyi Zhang, Tengfei Xue, Yang song, Nikos Makris, Yogesh Rathi, Alexandra J. Golby, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

We evaluate the effectiveness of the proposed method by predicting individual performance on two neuropsychological assessments of language using a dataset of 20 association white matter fiber tracts from 806 subjects from the Human Connectome Project.

regression

SynthMix: Mixing up Aligned Synthesis for Medical Cross-Modality Domain Adaptation

no code implementations7 May 2023 Xinwen Zhang, Chaoyi Zhang, Dongnan Liu, Qianbi Yu, Weidong Cai

The adversarial methods showed advanced performance by producing synthetic images to mitigate the domain shift, a common problem due to the hardship of acquiring labelled data in medical field.

Domain Adaptation Philosophy

PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration

1 code implementation6 Feb 2023 Dingxin Zhang, Jianhui Yu, Chaoyi Zhang, Weidong Cai

To solve this problem, we propose a rotation-invariant geometric relation to restore the relative pose with equivariant information for patches defined over different scales.

3D Object Classification Disentanglement

TractGraphCNN: anatomically informed graph CNN for classification using diffusion MRI tractography

no code implementations5 Jan 2023 Yuqian Chen, Fan Zhang, Leo R. Zekelman, Tengfei Xue, Chaoyi Zhang, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell

This work shows the potential of incorporating anatomical information, especially known anatomical similarities between input features, to guide convolutions in neural networks.

Rethinking Rotation Invariance with Point Cloud Registration

no code implementations31 Dec 2022 Jianhui Yu, Chaoyi Zhang, Weidong Cai

Recent investigations on rotation invariance for 3D point clouds have been devoted to devising rotation-invariant feature descriptors or learning canonical spaces where objects are semantically aligned.

3D Shape Classification Point Cloud Registration +1

Unsupervised Domain Adaptive Fundus Image Segmentation with Few Labeled Source Data

no code implementations10 Oct 2022 Qianbi Yu, Dongnan Liu, Chaoyi Zhang, Xinwen Zhang, Weidong Cai

To further facilitate the data efficiency of the cross-domain segmentation methods on the fundus images, we explore UDA optic disc and cup segmentation problems using few labeled source data in this work.

Image Segmentation Segmentation +3

White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning

no code implementations6 Jul 2022 Yuqian Chen, Fan Zhang, Chaoyi Zhang, Tengfei Xue, Leo R. Zekelman, Jianzhong He, Yang song, Nikos Makris, Yogesh Rathi, Alexandra J. Golby, Weidong Cai, Lauren J. O'Donnell

In this paper, we propose a deep-learning-based framework for neuropsychological score prediction using microstructure measurements estimated from diffusion magnetic resonance imaging (dMRI) tractography, focusing on predicting performance on a receptive vocabulary assessment task based on a critical fiber tract for language, the arcuate fasciculus (AF).

Towards Generalisable Audio Representations for Audio-Visual Navigation

no code implementations1 Jun 2022 Shunqi Mao, Chaoyi Zhang, Heng Wang, Weidong Cai

In audio-visual navigation (AVN), an intelligent agent needs to navigate to a constantly sound-making object in complex 3D environments based on its audio and visual perceptions.

Contrastive Learning Data Augmentation +2

Self-supervised Deep Unrolled Reconstruction Using Regularization by Denoising

no code implementations7 May 2022 Peizhou Huang, Chaoyi Zhang, Xiaoliang Zhang, Xiaojuan Li, Liang Dong, Leslie Ying

Experiment results demonstrate that the proposed method requires a reduced amount of training data to achieve high reconstruction quality among the state-of-art of MR reconstruction utilizing the Noise2Noise method.

Denoising MRI Reconstruction +1

Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellation

1 code implementation2 May 2022 Yuqian Chen, Chaoyi Zhang, Tengfei Xue, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances.

Anatomy Clustering +3

Spatiality-guided Transformer for 3D Dense Captioning on Point Clouds

1 code implementation22 Apr 2022 Heng Wang, Chaoyi Zhang, Jianhui Yu, Weidong Cai

Dense captioning in 3D point clouds is an emerging vision-and-language task involving object-level 3D scene understanding.

3D dense captioning 3D Object Detection +5

Towards Bi-directional Skip Connections in Encoder-Decoder Architectures and Beyond

no code implementations11 Mar 2022 Tiange Xiang, Chaoyi Zhang, Xinyi Wang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai

With the backward skip connections, we propose a U-Net based network family, namely Bi-directional O-shape networks, which set new benchmarks on multiple public medical imaging segmentation datasets.

Medical Image Segmentation Neural Architecture Search +1

SupWMA: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning

1 code implementation29 Jan 2022 Tengfei Xue, Fan Zhang, Chaoyi Zhang, Yuqian Chen, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell

Most parcellation methods focus on the deep white matter (DWM), while fewer methods address the superficial white matter (SWM) due to its complexity.

Contrastive Learning

Decompose to Adapt: Cross-domain Object Detection via Feature Disentanglement

1 code implementation6 Jan 2022 Dongnan Liu, Chaoyi Zhang, Yang song, Heng Huang, Chenyu Wang, Michael Barnett, Weidong Cai

Recent advances in unsupervised domain adaptation (UDA) techniques have witnessed great success in cross-domain computer vision tasks, enhancing the generalization ability of data-driven deep learning architectures by bridging the domain distribution gaps.

Disentanglement object-detection +2

SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detection

1 code implementation CVPR 2023 Tiange Xiang, Yixiao Zhang, Yongyi Lu, Alan L. Yuille, Chaoyi Zhang, Weidong Cai, Zongwei Zhou

Radiography imaging protocols focus on particular body regions, therefore producing images of great similarity and yielding recurrent anatomical structures across patients.

Anatomy Unsupervised Anomaly Detection

DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysis

no code implementations13 Sep 2021 Tiange Xiang, Yang song, Chaoyi Zhang, Dongnan Liu, Mei Chen, Fan Zhang, Heng Huang, Lauren O'Donnell, Weidong Cai

With image-level labels only, patch-wise classification would be sub-optimal due to inconsistency between the patch appearance and image-level label.

Classification whole slide images

Voxel-wise Cross-Volume Representation Learning for 3D Neuron Reconstruction

no code implementations14 Aug 2021 Heng Wang, Chaoyi Zhang, Jianhui Yu, Yang song, SiQi Liu, Wojciech Chrzanowski, Weidong Cai

Recently, a series of deep learning based segmentation methods have been proposed to improve the quality of raw 3D optical image stacks by removing noises and restoring neuronal structures from low-contrast background.

Representation Learning Segmentation

Deep Fiber Clustering: Anatomically Informed Unsupervised Deep Learning for Fast and Effective White Matter Parcellation

no code implementations11 Jul 2021 Yuqian Chen, Chaoyi Zhang, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

White matter fiber clustering (WMFC) enables parcellation of white matter tractography for applications such as disease classification and anatomical tract segmentation.

Clustering Segmentation +1

BiX-NAS: Searching Efficient Bi-directional Architecture for Medical Image Segmentation

1 code implementation26 Jun 2021 Xinyi Wang, Tiange Xiang, Chaoyi Zhang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai

We evaluate BiX-NAS on two segmentation tasks using three different medical image datasets, and the experimental results show that our BiX-NAS searched architecture achieves the state-of-the-art performance with significantly lower computational cost.

Image Segmentation Medical Image Segmentation +3

Partial Graph Reasoning for Neural Network Regularization

no code implementations3 Jun 2021 Tiange Xiang, Chaoyi Zhang, Yang song, SiQi Liu, Hongliang Yuan, Weidong Cai

This add-on graph regularizes the network during training and can be completely skipped during inference.

Single Neuron Segmentation using Graph-based Global Reasoning with Auxiliary Skeleton Loss from 3D Optical Microscope Images

no code implementations22 Jan 2021 Heng Wang, Yang song, Chaoyi Zhang, Jianhui Yu, SiQi Liu, Hanchuan Peng, Weidong Cai

One of the critical steps in improving accurate single neuron reconstruction from three-dimensional (3D) optical microscope images is the neuronal structure segmentation.

Segmentation

BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecture

1 code implementation1 Jul 2020 Tiange Xiang, Chaoyi Zhang, Dongnan Liu, Yang song, Heng Huang, Weidong Cai

U-Net has become one of the state-of-the-art deep learning-based approaches for modern computer vision tasks such as semantic segmentation, super resolution, image denoising, and inpainting.

Image Denoising Semantic Segmentation +1

ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis

1 code implementation9 May 2020 Jianhui Yu, Chaoyi Zhang, Yang song, Weidong Cai

Micro-expressions are reflections of people's true feelings and motives, which attract an increasing number of researchers into the study of automatic facial micro-expression recognition.

Generative Adversarial Network Micro Expression Recognition +1

SuperDTI: Ultrafast diffusion tensor imaging and fiber tractography with deep learning

no code implementations3 Feb 2020 Hongyu Li, Zifei Liang, Chaoyi Zhang, Ruiying Liu, Jing Li, Weihong Zhang, Dong Liang, Bowen Shen, Xiaoliang Zhang, Yulin Ge, Jiangyang Zhang, Leslie Ying

We also demonstrate that the trained neural network is robust to noise and motion in the testing data, and the network trained using healthy volunteer data can be directly applied to stroke patient data without compromising the lesion detectability.

Cannot find the paper you are looking for? You can Submit a new open access paper.