Search Results for author: Yuqing Xia

Found 4 papers, 3 papers with code

Retentive Network: A Successor to Transformer for Large Language Models

8 code implementations17 Jul 2023 Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei

In this work, we propose Retentive Network (RetNet) as a foundation architecture for large language models, simultaneously achieving training parallelism, low-cost inference, and good performance.

Language Modelling

A Neural Corpus Indexer for Document Retrieval

1 code implementation6 Jun 2022 Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang

To this end, we propose Neural Corpus Indexer (NCI), a sequence-to-sequence network that generates relevant document identifiers directly for a designated query.

Retrieval TriviaQA

Manifold Fitting under Unbounded Noise

1 code implementation23 Sep 2019 Zhigang Yao, Yuqing Xia

Numerical simulations are provided to validate our theoretical findings and demonstrate the advantages of our method over other relevant manifold fitting methods.

Dimensionality Reduction

Minimal Sample Subspace Learning: Theory and Algorithms

no code implementations13 Jul 2019 Zhenyue Zhang, Yuqing Xia

Subspace segmentation or subspace learning is a challenging and complicated task in machine learning.

Learning Theory

Cannot find the paper you are looking for? You can Submit a new open access paper.