Speech Recognition

1090 papers with code • 234 benchmarks • 87 datasets

Speech Recognition is the task of converting spoken language into text. It involves recognizing the words spoken in an audio recording and transcribing them into a written format. The goal is to accurately transcribe the speech in real-time or from recorded audio, taking into account factors such as accents, speaking speed, and background noise.

( Image credit: SpecAugment )

Libraries

Use these libraries to find Speech Recognition models and implementations
16 papers
7,875
13 papers
44
11 papers
29,255
See all 16 libraries.

Real-Time Multimodal Cognitive Assistant for Emergency Medical Services

uva-dsa/ems-pipeline 11 Mar 2024

Emergency Medical Services (EMS) responders often operate under time-sensitive conditions, facing cognitive overload and inherent risks, requiring essential skills in critical thinking and rapid decision-making.

13
11 Mar 2024

A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition

dalision/modalbiasavsr 7 Mar 2024

In this paper, we investigate this contrasting phenomenon from the perspective of modality bias and reveal that an excessive modality bias on the audio caused by dropout is the underlying reason.

6
07 Mar 2024

Language and Speech Technology for Central Kurdish Varieties

sinaahmadi/cordi 4 Mar 2024

Kurdish, an Indo-European language spoken by over 30 million speakers, is considered a dialect continuum and known for its diversity in language varieties.

8
04 Mar 2024

A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition

tbenst/silent_speech 2 Mar 2024

To the best of our knowledge, this work represents the first instance where noninvasive silent speech recognition on an open vocabulary has cleared the threshold of 15% WER, demonstrating that SSIs can be a viable alternative to automatic speech recognition (ASR).

5
02 Mar 2024

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing

sally-sh/vsp-llm 23 Feb 2024

In visual speech processing, context modeling capability is one of the most important requirements due to the ambiguous nature of lip movements.

271
23 Feb 2024

HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention

chrischen1023/hint 22 Feb 2024

In this paper, we propose an end-to-end High-quality INpainting Transformer, abbreviated as HINT, which consists of a novel mask-aware pixel-shuffle downsampling module (MPD) to preserve the visible information extracted from the corrupted image while maintaining the integrity of the information available for high-level inferences made within the model.

16
22 Feb 2024

How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena

hlt-mt/fbk-fairseq 20 Feb 2024

The attention mechanism, a cornerstone of state-of-the-art neural models, faces computational hurdles in processing long sequences due to its quadratic complexity.

28
20 Feb 2024

DeepCover: Advancing RNN Test Coverage and Online Error Prediction using State Machine Extraction

pouriagr/deep-cover 10 Feb 2024

The proposed methodology along with its assessment metrics contribute to increasing explainability in RNN models by providing a clear representation of their internal decision making process through the extracted SM.

1
10 Feb 2024

Streaming Sequence Transduction through Dynamic Compression

steventan0110/star 2 Feb 2024

We introduce STAR (Stream Transduction with Anchor Representations), a novel Transformer-based model designed for efficient sequence-to-sequence transduction over streams.

1
02 Feb 2024