1 code implementation • 13 Mar 2024 • Cheng Cheng, Hang Wang, Hongbin Sun
The prevalence of convolution neural networks (CNNs) and vision transformers (ViTs) has markedly revolutionized the area of single-image super-resolution (SISR).
no code implementations • 27 Feb 2024 • Xiaoyu Liu, Beitong Zhou, Cheng Cheng
However, CRL is mainly used as a pre-training technique, leading to a complicated multi-stage training pipeline.
no code implementations • 25 Feb 2024 • Cheng Cheng, Sovan Das, Stefan Videv, Adrian Spark, Sina Babadi, Aravindh Krishnamoorthy, Changmin Lee, Daniel Grieder, Kathleen Hartnett, Paul Rudy, James Raring, Marzieh Najafi, Vasilis K. Papanikolaou, Robert Schober, Harald Haas
In this paper, we demonstrate the communication capabilities of light-fidelity (LiFi) systems based on highbrightness and high-bandwidth integrated laser-based sources in a surface mount device (SMD) packaging platform.
1 code implementation • NeurIPS 2023 • Cheng Cheng, Lin Song, Ruoyi Xue, Hang Wang, Hongbin Sun, Yixiao Ge, Ying Shan
Without bells and whistles, our approach outperforms the state-of-the-art online few-shot learning method by an average of 3. 6\% on eight image classification datasets with higher inference speed.
1 code implementation • 30 Oct 2023 • Tianwen Wei, Liang Zhao, Lichang Zhang, Bo Zhu, Lijie Wang, Haihua Yang, Biye Li, Cheng Cheng, Weiwei Lü, Rui Hu, Chenxia Li, Liu Yang, Xilin Luo, Xuejie Wu, Lunan Liu, Wenjun Cheng, Peng Cheng, Jianhao Zhang, XiaoYu Zhang, Lei Lin, Xiaokun Wang, Yutuan Ma, Chuanhai Dong, Yanqi Sun, Yifu Chen, Yongyi Peng, Xiaojuan Liang, Shuicheng Yan, Han Fang, Yahui Zhou
In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3. 2 trillion tokens drawn from both English and Chinese texts.
1 code implementation • 19 May 2023 • Zhe Chen, Hao Tan, Tao Wang, Tianrun Shen, Tong Lu, Qiuying Peng, Cheng Cheng, Yue Qi
The core insight of our method is to fully consider the information propagation among nodes and edges in a graph when building the attention module in the transformer blocks.
Ranked #2 on Graph Regression on PCQM4M-LSC (Validation MAE metric)
no code implementations • 16 Feb 2023 • Wenbin Zhang, Zichong Wang, Juyong Kim, Cheng Cheng, Thomas Oommen, Pradeep Ravikumar, Jeremy Weiss
Algorithmic fairness, the research field of making machine learning (ML) algorithms fair, is an established area in ML.
no code implementations • 28 Aug 2022 • Helen Zhou, Cheng Cheng, Kelly J. Shields, Gursimran Kochhar, Tariq Cheema, Zachary C. Lipton, Jeremy C. Weiss
With COVID-19 now pervasive, identification of high-risk individuals is crucial.
no code implementations • 12 May 2022 • Yang Chen, Cheng Cheng, Qiyu Sun
The proposed GFT is consistent with the conventional GFT in the undirected graph setting, and on directed circulant graphs, the proposed GFT is the classical discrete Fourier transform, up to some rotation, permutation and phase adjustment.
no code implementations • 9 May 2022 • Cong Zheng, Cheng Cheng, Qiyu Sun
In this paper, we consider Wiener filters to reconstruct deterministic and (wide-band) stationary graph signals from their observations corrupted by random noises, and we propose distributed algorithms to implement Wiener filters and inverse filters on networks in which agents are equipped with a data processing subsystem for limited data storage and computation power, and with a one-hop communication subsystem for direct data exchange only with their adjacent agents.
1 code implementation • 14 Mar 2022 • Yun He, Xue Feng, Cheng Cheng, Geng Ji, Yunsong Guo, James Caverlee
Specifically, in each training iteration and adaptively for each part of the network, the gradient of an auxiliary loss is carefully reduced or enlarged to have a closer magnitude to the gradient of the target loss, preventing auxiliary tasks from being so strong that dominate the target task or too weak to help the target task.
no code implementations • 16 Feb 2022 • Kai-Fu Yang, Cheng Cheng, Shi-Xuan Zhao, Xian-Shi Zhang, Yong-Jie Li
Light adaptation or brightness correction is a key step in improving the contrast and visual appeal of an image.
no code implementations • 10 Dec 2021 • Sen Zhao, Yong Zhang, Shang Wang, Beitong Zhou, Cheng Cheng
Data-driven methods for remaining useful life (RUL) prediction normally learn features from a fixed window size of a priori of degradation, which may lead to less accurate prediction results on different datasets because of the variance of local features.
1 code implementation • 28 Oct 2021 • Jinhui Yuan, Xinqi Li, Cheng Cheng, Juncheng Liu, Ran Guo, Shenghang Cai, Chi Yao, Fei Yang, Xiaodong Yi, Chuan Wu, Haoran Zhang, Jie Zhao
Aiming at a simple, neat redesign of distributed deep learning frameworks for various parallelism paradigms, we present OneFlow, a novel distributed training framework based on an SBP (split, broadcast and partial-value) abstraction and the actor model.
no code implementations • 25 Oct 2021 • Cheng Cheng, Wei Dai
Dictionary learning aims at seeking a dictionary under which the training data can be sparsely represented.
no code implementations • 13 Oct 2021 • Cheng Cheng, Wei Dai
Typical methods for dictionary update focuses on refining both dictionary atoms and their corresponding sparse coefficients by using the sparsity patterns obtained from sparse coding stage, and hence it is a non-convex bilinear inverse problem.
no code implementations • 5 Oct 2021 • Xinxu Wei, Xianshi Zhang, Shisen Wang, Cheng Cheng, Yanlin Huang, KaiFu Yang, YongJie Li
We propose a Degradation-Aware Module (DA Module) which can guide the training process of the decomposer and enable the decomposer to be a restorer during the training phase without additional computational cost in the test phase.
no code implementations • 5 Oct 2021 • Cheng Cheng, Wei Dai
In the literature, formulations of blind deconvolution is either a convex programming via a matrix lifting of convolution, or a bilinear Lasso.
no code implementations • 30 Jun 2021 • Xinxu Wei, Xianshi Zhang, Shisen Wang, Cheng Cheng, Yanlin Huang, KaiFu Yang, YongJie Li
We propose a Noise and Color Bias Control module (NCBC Module) that contains a convolutional neural network and two loss functions (noise loss and color loss).
no code implementations • 28 Apr 2021 • Yangfan Zhou, Kaizhu Huang, Cheng Cheng, Xuguang Wang, Amir Hussain, Xin Liu
%on how to exploit strong convexity to further improve the convergence rate of AdaBelief.
no code implementations • 27 Oct 2020 • Cheng Cheng
Hydraulic fracturing stimulates fracture swarm in reservoir formation though pressurized injection fluid.
no code implementations • 28 Aug 2020 • Jiangjing Lyu, Xiaobo Li, Xiangyu Zhu, Cheng Cheng
It is also a challenging task due to the lack of high-quality datasets that can fuel current deep learning-based methods.
no code implementations • 10 Aug 2020 • Junlin Li, Wei Zhou, Cheng Cheng
For example, sparse Bayesian learning (SBL) was proposed to learn major features from a dictionary of basis functions, which makes identified models interpretable.
1 code implementation • 2 Jun 2020 • Helen Zhou, Cheng Cheng, Zachary C. Lipton, George H. Chen, Jeremy C. Weiss
Finally, the PEER score is provided in the form of a nomogram for direct calculation of patient risk, and can be used to highlight at-risk patients among critical care patients eligible for ECMO.
1 code implementation • 11 Mar 2020 • Yue Zhao, Xiyang Hu, Cheng Cheng, Cong Wang, Changlin Wan, Wen Wang, Jianing Yang, Haoping Bai, Zheng Li, Cao Xiao, Yunlong Wang, Zhi Qiao, Jimeng Sun, Leman Akoglu
Outlier detection (OD) is a key machine learning (ML) task for identifying abnormal objects from general samples with numerous high-stake applications including fraud detection and intrusion detection.
no code implementations • 1 Jan 2020 • Jing Zhang, Yong Zhang, Suhua Zhan, Cheng Cheng
Multiple physiological signals fusing models, building the uniform classification model by means of consistent and complementary information from different emotions to improve recognition performance.
no code implementations • 11 Nov 2019 • Siamak Shakeri, Abhinav Sethy, Cheng Cheng
In this paper we show that knowledge distillation can be used to encourage a model that generates claim independent document encodings to mimic the behavior of a more complex model which generates claim dependent encodings.
1 code implementation • 21 Sep 2019 • Yue Zhao, Xuejian Wang, Cheng Cheng, Xueying Ding
Model combination, often regarded as a key sub-field of ensemble learning, has been widely used in both academic research and industry applications.
no code implementations • Remote Sensing 2019 • Guangjun Xu, Cheng Cheng, Wenxian Yang, Wenhong Xie, Lingmei Kong, Renlong Hang, Furong Ma, Changming Dong, Jingsong Yang
Oceanic eddies play an important role in global energyand material transport, and contribute greatly to nutrient and phytoplankton distribution.
no code implementations • 1 Apr 2019 • Wenqian Jiang, Cheng Cheng, Beitong Zhou, Guijun Ma, Ye Yuan
This paper proposes a novel fault diagnosis approach based on generative adversarial networks (GAN) for imbalanced industrial time series where normal samples are much larger than failure cases.
no code implementations • 2 Mar 2019 • Cheng Cheng, Beitong Zhou, Guijun Ma, Dongrui Wu, Ye Yuan
However, for diverse working conditions in the industry, deep learning suffers two difficulties: one is that the well-defined (source domain) and new (target domain) datasets are with different feature distributions; another one is the fact that insufficient or no labelled data in target domain significantly reduce the accuracy of fault diagnosis.
no code implementations • 17 Dec 2018 • Ye Yuan, Guijun Ma, Cheng Cheng, Beitong Zhou, Huan Zhao, Hai-Tao Zhang, Han Ding
A central challenge in manufacturing sector lies in the requirement of a general framework to ensure satisfied diagnosis and monitoring performances in different manufacturing applications.
1 code implementation • 8 Dec 2018 • Cheng Cheng, Guijun Ma, Yong Zhang, Mingyang Sun, Fei Teng, Han Ding, Ye Yuan
In industrial applications, nearly half the failures of motors are caused by the degradation of rolling element bearings (REBs).
no code implementations • 18 Nov 2017 • Therese Anders, Hong Xu, Cheng Cheng, T. K. Satish Kumar
Territorial control is a key aspect shaping the dynamics of civil war.
1 code implementation • CVPR 2017 • Jiangjing Lv, Xiaohu Shao, Junliang Xing, Cheng Cheng, Xi Zhou
At the global stage, given an image with a rough face detection result, the full face region is firstly re-initialized by a supervised spatial transformer network to a canonical shape state and then trained to regress a coarse landmark estimation.