Search Results for author:
Found 5 papers, 3 papers with code
Improving Gloss-free Sign Language Translation by Reducing Representation Density
In this paper, we identify a representation density problem that could be a bottleneck in restricting the performance of gloss-free SLT.
Contrastive Learning
Gloss-free Sign Language Translation
+2
GeoDeformer: Geometric Deformable Transformer for Action Recognition
Specifically, at the core of GeoDeformer is the Geometric Deformation Predictor, a module designed to identify and quantify potential spatial and temporal geometric deformations within the given video.
Spatial-Temporal Alignment Network for Action Recognition
This paper studies introducing viewpoint invariant feature representations in existing action recognition architecture.
Cross-modality Data Augmentation for End-to-End Sign Language Translation
To tackle these challenges, we propose a novel Cross-modality Data Augmentation (XmDA) framework to transfer the powerful gloss-to-text translation capabilities to end-to-end sign language translation (i. e. video-to-text) by exploiting pseudo gloss-text pairs from the sign gloss translation model.
Ranked #4 on
Sign Language Translation
on CSL-Daily
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation
In this paper, to overcome the limitation, we propose a Prompt based domain text Generation (PGEN) approach to produce the large-scale in-domain spoken language text data.
