Search Results for author:
Found 12 papers, 5 papers with code
Guided Masked Self-Distillation Modeling for Distributed Multimedia Sensor Event Analysis
This is because the information obtained from a single sensor is often missing or fragmented in such an environment; observations from multiple locations and modalities should be integrated to analyze events comprehensively.
Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation
In detail, we explore multi-channel separation methods, mask-based beamforming and complex spectral mapping, as well as the best features to use in the ASR back-end model.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
Multi-Channel Target Speaker Extraction with Refinement: The WavLab Submission to the Second Clarity Enhancement Challenge
To address the challenges encountered in the CEC2 setting, we introduce four major novelties: (1) we extend the state-of-the-art TF-GridNet model, originally designed for monaural speaker separation, for multi-channel, causal speech enhancement, and large improvements are observed by replacing the TCNDenseNet used in iNeuBe with this new architecture; (2) we leverage a recent dual window size approach with future-frame prediction to ensure that iNueBe-X satisfies the 5 ms constraint on algorithmic latency required by CEC2; (3) we introduce a novel speaker-conditioning branch for TF-GridNet to achieve target speaker extraction; (4) we propose a fine-tuning step, where we compute an additional loss with respect to the target speaker signal compensated with the listener audiogram.
Inverse-free Online Independent Vector Analysis with Flexible Iterative Source Steering
In this paper, we propose a new online independent vector analysis (IVA) algorithm for real-time blind source separation (BSS).
Joint Optimization of Sampling Rate Offsets Based on Entire Signal Relationship Among Distributed Microphones
To address this problem, the proposed method jointly optimizes all SROs based on a probabilistic model of a multichannel signal.
Estimation of Consistent Time Delays in Subsample via Auxiliary-Function-Based Iterative Updates
We then consider a multidimensional CC (MCC) as the objective function, which is derived on the basis of maximum likelihood estimation.
Joint Dereverberation and Separation with Iterative Source Steering
In this case, we manage to reduce the number of matrix inversion to only one per iteration and source.
Independent Vector Analysis with more Microphones than Sources
The performance of the algorithm is assessed on simulated signals.
Sound Audio and Speech Processing
Multi-modal Blind Source Separation with Microphones and Blinkies
We show that alternating updates similar to those of independent vector analysis and Itakura-Saito non-negative matrix factorization decrease the negative log-likelihood of the joint distribution.
Sound Audio and Speech Processing
Deeply Learned Filter Response Functions for Hyperspectral Reconstruction
More interestingly, by considering physical restrictions in the design process, we are able to realize the deeply learned spectral response functions by using modern film filter production technologies, and thus construct data-inspired multispectral cameras for snapshot hyperspectral imaging.
A Stochastic Temporal Model of Polyphonic MIDI Performance with Ornaments
We study indeterminacies in realization of ornaments and how they can be incorporated in a stochastic performance model applicable for music information processing such as score-performance matching.
Outer-Product Hidden Markov Model and Polyphonic MIDI Score Following
We present a polyphonic MIDI score-following algorithm capable of following performances with arbitrary repeats and skips, based on a probabilistic model of musical performances.
