Search Results for author:
Found 17 papers, 0 papers with code
A Multimodal Approach to Device-Directed Speech Detection with Large Language Models
Interactions with virtual assistants typically start with a predefined trigger phrase followed by the user command.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Multimodal Data and Resource Efficient Device-Directed Speech Detection with Large Foundation Models
We compare the proposed system to unimodal baselines and show that the multimodal approach achieves lower equal-error-rates (EERs), while using only a fraction of the training data.
Audio-to-Intent Using Acoustic-Textual Subword Representations from End-to-End ASR
Accurate prediction of the user intent to interact with a voice assistant (VA) on a device (e. g. on the phone) is critical for achieving naturalistic, engaging, and privacy-centric interactions with the VA. To this end, we present a novel approach to predict the user's intent (the user speaking to the device or not) directly from acoustic and textual information encoded at subword tokens which are obtained via an end-to-end ASR model.
Improving Voice Trigger Detection with Metric Learning
A detector is typically trained on speech data independent of speaker information and used for the voice trigger detection task.
Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models
We also show that the ensemble of the LatticeRNN and acoustic-distilled models brings further accuracy improvement of 20%.
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations
By aligning audio representations to pretrained language representations and utilizing contrastive information between acoustic inputs, CALM is able to bootstrap audio embedding competitive with existing audio representation models in only a few hours of training time.
Whispered and Lombard Neural Speech Synthesis
2) Although our speaker verification (SV) model is not explicitly trained to discriminate different speaking styles, and no Lombard and whisper voice is used for pre-training this system, the SV model can be used as a style encoder for generating different style embeddings as input for the Tacotron system.
Progressive Voice Trigger Detection: Accuracy vs Latency
We first demonstrate that by including more audio context after a detected trigger phrase, we can indeed get a more accurate decision.
Knowledge Transfer for Efficient On-device False Trigger Mitigation
But in case of a false trigger, transcribing the audio using ASR itself is strongly undesirable.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
On the Role of Visual Cues in Audiovisual Speech Enhancement
One byproduct of this finding is that the learned visual embeddings can be used as features for other visual speech applications.
Generating Multilingual Voices Using Speaker Space Translation Based on Bilingual Speaker Data
We demonstrate that a bilingual speaker embedding space contains a separate distribution for each language and that a simple transform in speaker space generated by the speaker embedding can be used to control the degree of accent of a synthetic voice in a language.
Detecting Emotion Primitives from Speech and their use in discerning Categorical Emotions
Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity.
Multi-task Learning for Speaker Verification and Voice Trigger Detection
We train the network in a supervised multi-task learning setup, where the speech transcription branch of the network is trained to minimise a phonetic connectionist temporal classification (CTC) loss while the speaker recognition branch of the network is trained to label the input sequence with the correct label for the speaker.
Leveraging Acoustic Cues and Paralinguistic Embeddings to Detect Expression from Voice
The expectation is that such assistants should understand the intent of the users query.
Introducing the Weighted Trustability Evaluator for Crowdsourcing Exemplified by Speaker Likability Classification
Crowdsourcing is an arising collaborative approach applicable among many other applications to the area of language and speech processing.
Detecting Road Surface Wetness from Audio: A Deep Learning Approach
We introduce a recurrent neural network architecture for automated road surface wetness detection from audio of tire-surface interaction.
The state of play of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions
Individuals with Autism Spectrum Conditions (ASC) have marked difficulties using verbal and non-verbal communication for social interaction.
