Search Results for author: Zhengyang Li

Found 8 papers, 2 papers with code

Perception of Misalignment States for Sky Survey Telescopes with the Digital Twin and the Deep Neural Networks

no code implementations30 Nov 2023 Miao Zhang, Peng Jia, Zhengyang Li, Wennan Xiang, Jiameng Lv, Rui Sun

To address this, we need a method to obtain misalignment states, aiding in the reconstruction of accurate point spread functions for data processing methods or facilitating adjustments of optical components for improved image quality.

Astronomy

Relaxed Attention for Transformer Models

1 code implementation20 Sep 2022 Timo Lohrenz, Björn Möller, Zhengyang Li, Tim Fingscheidt

The powerful modeling capabilities of all-attention-based transformer architectures often cause overfitting and - for natural language processing tasks - lead to an implicitly learned internal language model in the autoregressive transformer decoder complicating the integration of external language models.

Ranked #3 on Lipreading on LRS3-TED (using extra training data)

Image Classification Language Modelling +3

Federated Split BERT for Heterogeneous Text Classification

no code implementations26 May 2022 Zhengyang Li, Shijing Si, Jianzong Wang, Jing Xiao

To address this issue, we propose a framework, FedSplitBERT, which handles heterogeneous data and decreases the communication cost by splitting the BERT encoder layers into local part and global part.

Federated Learning Quantization +2

Bandwidth-Scalable Fully Mask-Based Deep FCRN Acoustic Echo Cancellation and Postfiltering

no code implementations9 May 2022 Ernst Seidel, Rasmus Kongsgaard Olsson, Karim Haddad, Zhengyang Li, Pejman Mowlaee, Tim Fingscheidt

Although today's speech communication systems support various bandwidths from narrowband to super-wideband and beyond, state-of-the art DNN methods for acoustic echo cancellation (AEC) are lacking modularity and bandwidth scalability.

Acoustic echo cancellation Bandwidth Extension

Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition

no code implementations31 Mar 2021 Timo Lohrenz, Zhengyang Li, Tim Fingscheidt

Stream fusion, also known as system combination, is a common technique in automatic speech recognition for traditional hybrid hidden Markov model approaches, yet mostly unexplored for modern deep neural network end-to-end model architectures.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Point Spread Function Modelling for Wide Field Small Aperture Telescopes with a Denoising Autoencoder

no code implementations31 Jan 2020 Peng Jia, Xiyu Li, Zhengyang Li, Weinan Wang, Dongmei Cai

For wide field small aperture telescopes, the point spread function is hard to model, because it is affected by many different effects and has strong temporal and spatial variations.

Denoising

Cannot find the paper you are looking for? You can Submit a new open access paper.