1 code implementation • 22 Apr 2024 • Dengchun Li, Yingzi Ma, Naizheng Wang, Zhiyuan Cheng, Lei Duan, Jie Zuo, Cal Yang, Mingjie Tang
Unlike other LoRA based MoE methods, MixLoRA enhances model performance by utilizing independently configurable attention-layer LoRA adapters, supporting the use of LoRA and its variants for the construction of experts, and applying auxiliary load balance loss to address the imbalance problem of the router.
no code implementations • 16 Jan 2024 • Lei Duan, Ziyang Jiang, David Carlson
We show that the proposed data augmentation strategy helps enhance the performance of the state-of-the-art convolutional neural network-random forest (CNN-RF) model by a reasonable amount, resulting in a noteworthy improvement in spatial correlation and a reduction in prediction error.
1 code implementation • 5 Dec 2023 • Zhengmao Ye, Dengchun Li, Jingqi Tian, Tingfeng Lan, Jie Zuo, Lei Duan, Hui Lu, Yexi Jiang, Jian Sha, Ke Zhang, Mingjie Tang
Transformer-based large language models (LLMs) have demonstrated outstanding performance across diverse domains, particularly when fine-turned for specific domains.
no code implementations • 20 Jan 2021 • Debarchan Das, D. T. Adroja, M. R. Lees, R. W. Taylor, Z. S. Bishnoi, V. K. Anand, A. Bhattacharyya, Z. Guguchia, C. Baines, H. Luetkens, G. B. G. Stenning, Lei Duan, Xiancheng Wang, Changqing Jin
The superconducting gap structure of a topological crystalline insulator (TCI) candidate ZrRuAs ($T^{\rm on}_{\rm c}$ = 7. 9(1) K) with a noncentrosymmetric crystal structure has been investigated using muon spin rotation/relaxation ($\mu$SR) measurements in transverse-field (TF) and zero-field (ZF) geometries.
Superconductivity Strongly Correlated Electrons
1 code implementation • 1 Nov 2018 • Ying Tai, Yicong Liang, Xiaoming Liu, Lei Duan, Jilin Li, Chengjie Wang, Feiyue Huang, Yu Chen
In recent years, heatmap regression based models have shown their effectiveness in face alignment and pose estimation.