Search Results for author: Yu Pan

Found 38 papers, 15 papers with code

Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach

no code implementations24 Apr 2024 Linyu Liu, Yu Pan, Xiaocheng Li, Guanting Chen

Large language models (LLMs) are highly capable of many tasks but they can sometimes generate unreliable or inaccurate outputs.

PromptCodec: High-Fidelity Neural Speech Codec using Disentangled Representation Learning based Adaptive Feature-aware Prompt Encoders

no code implementations3 Apr 2024 Yu Pan, Lei Ma, Jianjun Zhao

Neural speech codec has recently gained widespread attention in generative speech modeling domains, like voice conversion, text-to-speech synthesis, etc.

Representation Learning Speech Synthesis +2

Cumulative Distribution Function based General Temporal Point Processes

no code implementations1 Feb 2024 Maolin Wang, Yu Pan, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao, Wanyu Wang, Yiqi Wang, Zitao Liu, Langming Liu

Our contributions encompass the introduction of a pioneering CDF-based TPP model, the development of a methodology for incorporating past event information into future event prediction, and empirical validation of CuFun's effectiveness through extensive experimentation on synthetic and real-world datasets.

Information Retrieval Point Processes +1

Preparing Lessons for Progressive Training on Language Models

1 code implementation17 Jan 2024 Yu Pan, Ye Yuan, Yichun Yin, Jiaxin Shi, Zenglin Xu, Ming Zhang, Lifeng Shang, Xin Jiang, Qun Liu

The rapid progress of Transformers in artificial intelligence has come at the cost of increased resource consumption and greenhouse gas emissions due to growing model sizes.

Transforming Agriculture with Intelligent Data Management and Insights

no code implementations7 Nov 2023 Yu Pan, Jianxin Sun, Hongfeng Yu, Geng Bai, Yufeng Ge, Joe Luck, Tala Awada

At the same time, the sheer amount of data poses a great challenge to data storage and analysis, and the \textit{de facto} data management and analysis practices adopted by scientists have become increasingly inefficient.

Management

On the Convergence of Federated Averaging under Partial Participation for Over-parameterized Neural Networks

no code implementations9 Oct 2023 Xin Liu, Wei Li, Dazhi Zhan, Yu Pan, Xin Ma, Yu Ding, Zhisong Pan

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data.

Federated Learning

Enhanced Federated Optimization: Adaptive Unbiased Sampling with Reduced Variance

no code implementations4 Oct 2023 Dun Zeng, Zenglin Xu, Yu Pan, Xu Luo, Qifan Wang, Xiaoying Tang

Central to this process is the technique of unbiased client sampling, which ensures a representative selection of clients.

Federated Learning

Tackling Hybrid Heterogeneity on Federated Optimization via Gradient Diversity Maximization

1 code implementation4 Oct 2023 Dun Zeng, Zenglin Xu, Yu Pan, Qifan Wang, Xiaoying Tang

The combined effects of statistical and system heterogeneity can significantly reduce the efficiency of federated optimization.

Federated Learning

PromptVC: Flexible Stylistic Voice Conversion in Latent Space Driven by Natural Language Prompts

no code implementations17 Sep 2023 Jixun Yao, Yuguang Yang, Yi Lei, Ziqian Ning, Yanni Hu, Yu Pan, JingJing Yin, Hongbin Zhou, Heng Lu, Lei Xie

In this study, we propose PromptVC, a novel style voice conversion approach that employs a latent diffusion model to generate a style vector driven by natural language prompts.

Voice Conversion

MSAC: Multiple Speech Attribute Control Method for Reliable Speech Emotion Recognition

no code implementations8 Aug 2023 Yu Pan, Yuguang Yang, Yuheng Huang, Jixun Yao, JingJing Yin, Yanni Hu, Heng Lu, Lei Ma, Jianjun Zhao

Despite notable progress, speech emotion recognition (SER) remains challenging due to the intricate and ambiguous nature of speech emotion, particularly in wild world.

Attribute Cross-corpus +2

Quantity-Aware Coarse-to-Fine Correspondence for Image-to-Point Cloud Registration

no code implementations14 Jul 2023 Gongxin Yao, Yixin Xuan, YiWei Chen, Yu Pan

Image-to-point cloud registration aims to determine the relative camera pose between an RGB image and a reference point cloud, serving as a general solution for locating 3D objects from 2D observations.

Image to Point Cloud Registration

GEmo-CLAP: Gender-Attribute-Enhanced Contrastive Language-Audio Pretraining for Accurate Speech Emotion Recognition

no code implementations13 Jun 2023 Yu Pan, Yanni Hu, Yuguang Yang, Wen Fei, Jixun Yao, Heng Lu, Lei Ma, Jianjun Zhao

Contrastive cross-modality pretraining has recently exhibited impressive success in diverse fields, whereas there is limited research on their merits in speech emotion recognition (SER).

Attribute Contrastive Learning +3

Tensorized Hypergraph Neural Networks

no code implementations5 Jun 2023 Maolin Wang, Yaoming Zhen, Yu Pan, Yao Zhao, Chenyi Zhuang, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao

THNN is a faithful hypergraph modeling framework through high-order outer product feature message passing and is a natural tensor extension of the adjacency-matrix-based graph neural networks.

Single-photon Image Super-resolution via Self-supervised Learning

no code implementations3 Mar 2023 YiWei Chen, Chen Jiang, Yu Pan

Single-Photon Image Super-Resolution (SPISR) aims to recover a high-resolution volumetric photon counting cube from a noisy low-resolution one by computational imaging algorithms.

Image Super-Resolution Self-Supervised Learning

Tensor Networks Meet Neural Networks: A Survey and Future Perspectives

1 code implementation22 Jan 2023 Maolin Wang, Yu Pan, Zenglin Xu, Xiangli Yang, Guangxi Li, Andrzej Cichocki

Interestingly, although these two types of networks originate from different observations, they are inherently linked through the common multilinearity structure underlying both TNs and NNs, thereby motivating a significant number of intellectual developments regarding combinations of TNs and NNs.

Tensor Networks

A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks

1 code implementation28 May 2022 Yu Pan, Zeyong Su, Ao Liu, Jingquan Wang, Nannan Li, Zenglin Xu

To address this problem, we propose a universal weight initialization paradigm, which generalizes Xavier and Kaiming methods and can be widely applicable to arbitrary TCNNs.

Tensor Decomposition

Multiple Domain Cyberspace Attack and Defense Game Based on Reward Randomization Reinforcement Learning

no code implementations23 May 2022 Lei Zhang, Yu Pan, Yi Liu, Qibin Zheng, Zhisong Pan

In order to improve the defense ability of defender, a game model based on reward randomization reinforcement learning is proposed.

reinforcement-learning Reinforcement Learning (RL)

Semantically Proportional Patchmix for Few-Shot Learning

no code implementations17 Feb 2022 Jingquan Wang, Jing Xu, Yu Pan, Zenglin Xu

Few-shot learning aims to classify unseen classes with only a limited number of labeled data.

Few-Shot Learning Transfer Learning

Deep Domain Adversarial Adaptation for Photon-efficient Imaging

2 code implementations7 Jan 2022 YiWei Chen, Gongxin Yao, Yong liu, Hongye Su, Xiaomin Hu, Yu Pan

Photon-efficient imaging with the single-photon light detection and ranging (LiDAR) captures the three-dimensional (3D) structure of a scene by only a few detected signal photons per pixel.

Domain Adaptation

Robust photon-efficient imaging using a pixel-wise residual shrinkage network

2 code implementations5 Jan 2022 Gongxin Yao, YiWei Chen, Yong liu, Xiaomin Hu, Yu Pan

Single-photon light detection and ranging (LiDAR) has been widely applied to 3D imaging in challenging scenarios.

Depth Estimation

Assessing Deep Neural Networks as Probability Estimators

no code implementations16 Nov 2021 Yu Pan, Kwo-Sen Kuo, Michael L. Rilee, Hongfeng Yu

Deep Neural Networks (DNNs) have performed admirably in classification tasks.

Classification

Graph Partner Neural Networks for Semi-Supervised Learning on Graphs

no code implementations18 Oct 2021 Langzhang Liang, Cuiyun Gao, Shiyi Chen, Shishi Duan, Yu Pan, Junjin Zheng, Lei Wang, Zenglin Xu

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification.

Graph Classification Link Prediction +1

Fast query-by-example speech search using separable model

no code implementations18 Sep 2021 Yuguang Yang, Yu Pan, Xin Dong, Minqiang Xu

Second, we design a novel model inference scheme based on RepVGG which can efficiently improve the QbE search quality.

Word Embeddings

Residual Tensor Train: A Quantum-inspired Approach for Learning Multiple Multilinear Correlations

1 code implementation19 Aug 2021 YiWei Chen, Yu Pan, Daoyi Dong

We prove that such a rule is much more relaxed than that of TT, which means ResTT can easily address the vanishing and exploding gradient problem that exists in the existing TT models.

AFINet: Attentive Feature Integration Networks for Image Classification

no code implementations10 May 2021 Xinglin Pan, Jing Xu, Yu Pan, Liangjian Wen, WenXiang Lin, Kun Bai, Zenglin Xu

Convolutional Neural Networks (CNNs) have achieved tremendous success in a number of learning tasks including image classification.

Classification General Classification +1

TedNet: A Pytorch Toolkit for Tensor Decomposition Networks

1 code implementation11 Apr 2021 Yu Pan, Maolin Wang, Zenglin Xu

Tensor Decomposition Networks (TDNs) prevail for their inherent compact architectures.

Tensor Decomposition

Detecting quantum entanglement with unsupervised learning

1 code implementation8 Mar 2021 YiWei Chen, Yu Pan, Guofeng Zhang, Shuming Cheng

Quantum properties, such as entanglement and coherence, are indispensable resources in various quantum information processing tasks.

Spectrum Attention Mechanism for Time Series Classification

no code implementations25 Jan 2021 Shibo Zhou, Yu Pan

Since time series always contains a lot of noise, which has a negative impact on network training, people usually filter the original data before training the network.

Classification General Classification +3

AFINets: Attentive Feature Integration Networks for Image Classification

no code implementations1 Jan 2021 Xinglin Pan, Jing Xu, Yu Pan, WenXiang Lin, Liangjian Wen, Zenglin Xu

Convolutional Neural Networks (CNNs) have achieved tremendous success in a number of learning tasks, e. g., image classification.

Classification General Classification +1

Heuristic Rank Selection with Progressively Searching Tensor Ring Network

no code implementations22 Sep 2020 Nannan Li, Yu Pan, Yaran Chen, Zixiang Ding, Dongbin Zhao, Zenglin Xu

Interestingly, we discover that part of the rank elements is sensitive and usually aggregate in a narrow region, namely an interest region.

Quantum Language Model with Entanglement Embedding for Question Answering

no code implementations23 Aug 2020 Yi-Wei Chen, Yu Pan, Daoyi Dong

Quantum Language Models (QLMs) in which words are modelled as quantum superposition of sememes have demonstrated a high level of model transparency and good post-hoc interpretability.

Language Modelling Question Answering

Making Adversarial Examples More Transferable and Indistinguishable

2 code implementations8 Jul 2020 Junhua Zou, Yexin Duan, Boyu Li, Wu Zhang, Yu Pan, Zhisong Pan

Fast gradient sign attack series are popular methods that are used to generate adversarial examples.

Compressing Recurrent Neural Networks with Tensor Ring for Action Recognition

1 code implementation NIPS Workshop CDNNRIA 2018 Yu Pan, Jing Xu, Maolin Wang, Jinmian Ye, Fei Wang, Kun Bai, Zenglin Xu

Recurrent Neural Networks (RNNs) and their variants, such as Long-Short Term Memory (LSTM) networks, and Gated Recurrent Unit (GRU) networks, have achieved promising performance in sequential data modeling.

Action Recognition Temporal Action Localization +1

Cannot find the paper you are looking for? You can Submit a new open access paper.