Search Results for author: Jing-Hao Xue

Found 48 papers, 24 papers with code

UMBRAE: Unified Multimodal Decoding of Brain Signals

no code implementations10 Apr 2024 Weihao Xia, Raoul de Charette, Cengiz Öztireli, Jing-Hao Xue

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models.

Language Modelling Large Language Model

High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identification

1 code implementation13 Dec 2023 Liuxiang Qiu, Si Chen, Yan Yan, Jing-Hao Xue, Da-Han Wang, Shunzhi Zhu

Existing VI-ReID methods ignore high-order structure information of features while being relatively difficult to learn a reasonable common feature space due to the large modality discrepancy between VIS and IR images.

Person Re-Identification

Spatial-Contextual Discrepancy Information Compensation for GAN Inversion

1 code implementation12 Dec 2023 Ziqiang Zhang, Yan Yan, Jing-Hao Xue, Hanzi Wang

SDIC follows a "compensate-and-edit" paradigm and successfully bridges the gap in image details between the original image and the reconstructed/edited image.

DREAM: Visual Decoding from Reversing Human Visual System

no code implementations3 Oct 2023 Weihao Xia, Raoul de Charette, Cengiz Öztireli, Jing-Hao Xue

In this work we present DREAM, an fMRI-to-image method for reconstructing viewed images from brain activities, grounded on fundamental knowledge of the human visual system.

A Survey on Deep Generative 3D-aware Image Synthesis

1 code implementation25 Oct 2022 Weihao Xia, Jing-Hao Xue

Recent years have seen remarkable progress in deep learning powered visual content creation.

3D-Aware Image Synthesis

Modelling Latent Dynamics of StyleGAN using Neural ODEs

1 code implementation23 Aug 2022 Weihao Xia, Yujiu Yang, Jing-Hao Xue

The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent code, by considering each latent code as a moving particle and the latent space as a high-dimensional dynamic system.

Video Editing

Learn-to-Decompose: Cascaded Decomposition Network for Cross-Domain Few-Shot Facial Expression Recognition

1 code implementation16 Jul 2022 Xinyi Zou, Yan Yan, Jing-Hao Xue, Si Chen, Hanzi Wang

Extensive experiments on both in-the-lab and in-the-wild compound expression datasets demonstrate the superiority of our proposed CDNet against several state-of-the-art FSL methods.

cross-domain few-shot learning Facial Expression Recognition +1

Stage-Aware Feature Alignment Network for Real-Time Semantic Segmentation of Street Scenes

no code implementations8 Mar 2022 Xi Weng, Yan Yan, Si Chen, Jing-Hao Xue, Hanzi Wang

In this paper, we present a novel Stage-aware Feature Alignment Network (SFANet) based on the encoder-decoder structure for real-time semantic segmentation of street scenes.

Real-Time Semantic Segmentation Segmentation

When Facial Expression Recognition Meets Few-Shot Learning: A Joint and Alternate Learning Framework

no code implementations18 Jan 2022 Xinyi Zou, Yan Yan, Jing-Hao Xue, Si Chen, Hanzi Wang

To alleviate the problem of limited base classes in our FER task, we propose a novel Emotion Guided Similarity Network (EGS-Net), consisting of an emotion branch and a similarity branch, based on a two-stage learning framework.

cross-domain few-shot learning Facial Expression Recognition +1

Dimension Reduction for Data with Heterogeneous Missingness

1 code implementation24 Sep 2021 Yurong Ling, Zijing Liu, Jing-Hao Xue

Dimension reduction plays a pivotal role in analysing high-dimensional data.

Dimensionality Reduction

Learning Spatial-Semantic Relationship for Facial Attribute Recognition With Limited Labeled Data

no code implementations CVPR 2021 Ying Shu, Yan Yan, Si Chen, Jing-Hao Xue, Chunhua Shen, Hanzi Wang

First, three auxiliary tasks, consisting of a Patch Rotation Task (PRT), a Patch Segmentation Task (PST), and a Patch Classification Task (PCT), are jointly developed to learn the spatial-semantic relationship from large-scale unlabeled facial data.

Attribute Facial Attribute Classification +1

Deep Metric Learning for Few-Shot Image Classification: A Review of Recent Developments

no code implementations17 May 2021 Xiaoxu Li, Xiaochen Yang, Zhanyu Ma, Jing-Hao Xue

Few-shot image classification is a challenging problem that aims to achieve the human level of recognition based only on a small number of training images.

Classification Few-Shot Image Classification +3

SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes

no code implementations19 Apr 2021 Jiacheng Chen, Bin-Bin Gao, Zongqing Lu, Jing-Hao Xue, Chengjie Wang, Qingmin Liao

To this end, we generate self-contrastive background prototypes directly from the query image, with which we enable the construction of complete sample pairs and thus a complementary and auxiliary segmentation task to achieve the training of a better segmentation model.

Few-Shot Semantic Segmentation Metric Learning +2

Towards Open-World Text-Guided Face Image Generation and Manipulation

2 code implementations18 Apr 2021 Weihao Xia, Yujiu Yang, Jing-Hao Xue, Baoyuan Wu

To be specific, we propose a brand new paradigm of text-guided image generation and manipulation based on the superior characteristics of a pretrained GAN model.

Language Modelling Semantic Segmentation +1

GAN Inversion: A Survey

1 code implementation14 Jan 2021 Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, Ming-Hsuan Yang

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator.

Image Manipulation Image Restoration

Generalization Bound of Gradient Descent for Non-Convex Metric Learning

1 code implementation NeurIPS 2020 Mingzhi Dong, Xiaochen Yang, Rui Zhu, Yujiang Wang, Jing-Hao Xue

Metric learning aims to learn a distance measure that can benefit distance-based methods such as the nearest neighbour (NN) classifier.

Metric Learning

BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification

1 code implementation29 Nov 2020 Xiaoxu Li, Jijie Wu, Zhuo Sun, Zhanyu Ma, Jie Cao, Jing-Hao Xue

Motivated by this, we propose a so-called \textit{Bi-Similarity Network} (\textit{BSNet}) that consists of a single embedding module and a bi-similarity module of two similarity measures.

Few-Shot Learning Fine-Grained Image Classification +1

DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference

no code implementations17 Nov 2020 Jiyang Xie, Zhanyu Ma, Jing-Hao Xue, Guoqiang Zhang, Jun Guo

In the DS-UI, we combine the classifier of a DNN, i. e., the last fully-connected (FC) layer, with a mixture of Gaussian mixture models (MoGMM) to obtain an MoGMM-FC layer.

Controllable Continuous Gaze Redirection

1 code implementation9 Oct 2020 Weihao Xia, Yujiu Yang, Jing-Hao Xue, Wensen Feng

The encoder maps images into a well-disentangled and hierarchically-organized latent space.

Attribute gaze redirection

ReMarNet: Conjoint Relation and Margin Learning for Small-Sample Image Classification

1 code implementation27 Jun 2020 Xiaoxu Li, Liyun Yu, Xiaochen Yang, Zhanyu Ma, Jing-Hao Xue, Jie Cao, Jun Guo

Despite achieving state-of-the-art performance, deep learning methods generally require a large amount of labeled data during training and may suffer from overfitting when the sample size is small.

Classification General Classification +3

Towards Certified Robustness of Distance Metric Learning

1 code implementation10 Jun 2020 Xiaochen Yang, Yiwen Guo, Mingzhi Dong, Jing-Hao Xue

Many existing methods consider maximizing or at least constraining a distance margin in the feature space that separates similar and dissimilar pairs of instances to guarantee their generalization ability.

Metric Learning

A Concise Review of Recent Few-shot Meta-learning Methods

no code implementations22 May 2020 Xiaoxu Li, Zhuo Sun, Jing-Hao Xue, Zhanyu Ma

Few-shot meta-learning has been recently reviving with expectations to mimic humanity's fast adaption to new concepts based on prior knowledge.

Meta-Learning

OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer

1 code implementation20 Apr 2020 Xiaoxu Li, Dongliang Chang, Zhanyu Ma, Zheng-Hua Tan, Jing-Hao Xue, Jie Cao, Jingyi Yu, Jun Guo

A deep neural network of multiple nonlinear layers forms a large function space, which can easily lead to overfitting when it encounters small-sample data.

Classification General Classification

Real-MFF: A Large Realistic Multi-focus Image Dataset with Ground Truth

no code implementations28 Mar 2020 Juncheng Zhang, Qingmin Liao, Shaojun Liu, Haoyu Ma, Wenming Yang, Jing-Hao Xue

In this letter, we introduce a large and realistic multi-focus dataset called Real-MFF, which contains 710 pairs of source images with corresponding ground truth images.

XSepConv: Extremely Separated Convolution

no code implementations27 Feb 2020 Jiarong Chen, Zongqing Lu, Jing-Hao Xue, Qingmin Liao

Depthwise convolution has gradually become an indispensable operation for modern efficient neural networks and larger kernel sizes ($\ge5$) have been applied to it recently.

Deep Multi-task Multi-label CNN for Effective Facial Attribute Classification

no code implementations10 Feb 2020 Longbiao Mao, Yan Yan, Jing-Hao Xue, Hanzi Wang

Two different network architectures are respectively designed to extract features for two groups of attributes, and a novel dynamic weighting scheme is proposed to automatically assign the loss weight to each facial attribute during training.

Attribute Face Detection +5

An α-Matte Boundary Defocus Model Based Cascaded Network for Multi-focus Image Fusion

2 code implementations29 Oct 2019 Haoyu Ma, Qingmin Liao, Juncheng Zhang, Shaojun Liu, Jing-Hao Xue

Based on this {\alpha}-matte defocus model and the generated data, a cascaded boundary aware convolutional network termed MMF-Net is proposed and trained, aiming to achieve clearer fusion results around the FDB.

Discriminant analysis based on projection onto generalized difference subspace

no code implementations29 Oct 2019 Kazuhiro Fukui, Naoya Sogi, Takumi Kobayashi, Jing-Hao Xue, Atsuto Maki

To avoid the difficulty, we first introduce geometrical Fisher discriminant analysis (gFDA) based on a simplified Fisher criterion.

LCSCNet: Linear Compressing Based Skip-Connecting Network for Image Super-Resolution

1 code implementation9 Sep 2019 Wenming Yang, Xuechen Zhang, Yapeng Tian, Wei Wang, Jing-Hao Xue, Qingmin Liao

In this paper, we develop a concise but efficient network architecture called linear compressing based skip-connecting network (LCSCNet) for image super-resolution.

Image Super-Resolution

Constrained Mutual Convex Cone Method for Image Set Based Recognition

no code implementations14 Mar 2019 Naoya Sogi, Rui Zhu, Jing-Hao Xue, Kazuhiro Fukui

Moreover, to enhance the framework, we introduce a discriminant space that maximizes the between-class variance (gaps) and minimizes the within-class variance of the projected convex cones onto the discriminant space, similar to the Fisher discriminant analysis.

Classification General Classification

Bi-stream Pose Guided Region Ensemble Network for Fingertip Localization from Stereo Images

no code implementations26 Feb 2019 Guijin Wang, Cairong Zhang, Xinghao Chen, Xiangyang Ji, Jing-Hao Xue, Hang Wang

To mitigate these limitations and promote further research on hand pose estimation from stereo images, we propose a new large-scale binocular hand pose dataset called THU-Bi-Hand, offering a new perspective for fingertip localization.

3D Hand Pose Estimation

Deep Learning for Single Image Super-Resolution: A Brief Review

1 code implementation9 Aug 2018 Wenming Yang, Xuechen Zhang, Yapeng Tian, Wei Wang, Jing-Hao Xue

Single image super-resolution (SISR) is a notoriously challenging ill-posed problem, which aims to obtain a high-resolution (HR) output from one of its low-resolution (LR) versions.

Efficient Neural Network Image Super-Resolution

SEA: A Combined Model for Heat Demand Prediction

no code implementations28 Jul 2018 Jiyang Xie, Jiaxin Guo, Zhanyu Ma, Jing-Hao Xue, Qie Sun, Hailong Li, Jun Guo

ENN and ARIMA are used to predict seasonal and trend components, respectively.

BALSON: Bayesian Least Squares Optimization with Nonnegative L1-Norm Constraint

no code implementations8 Jul 2018 Jiyang Xie, Zhanyu Ma, Guo-Qiang Zhang, Jing-Hao Xue, Jen-Tzung Chien, Zhiqing Lin, Jun Guo

In order to explicitly characterize the nonnegative L1-norm constraint of the parameters, we further approximate the true posterior distribution by a Dirichlet distribution.

Learning Local Metrics and Influential Regions for Classification

no code implementations9 Feb 2018 Mingzhi Dong, Yujiang Wang, Xiaochen Yang, Jing-Hao Xue

The performance of distance-based classifiers heavily depends on the underlying distance metric, so it is valuable to learn a suitable metric from the data.

Classification General Classification +1

Metric Learning via Maximizing the Lipschitz Margin Ratio

no code implementations9 Feb 2018 Mingzhi Dong, Xiaochen Yang, Yang Wu, Jing-Hao Xue

In this paper, we propose the Lipschitz margin ratio and a new metric learning framework for classification through maximizing the ratio.

Metric Learning

Decorrelation of Neutral Vector Variables: Theory and Applications

no code implementations30 May 2017 Zhanyu Ma, Jing-Hao Xue, Arne Leijon, Zheng-Hua Tan, Zhen Yang, Jun Guo

In this paper, we propose novel strategies for neutral vector variable decorrelation.

Cannot find the paper you are looking for? You can Submit a new open access paper.