Search Results for author:
Found 16 papers, 5 papers with code
LoSA: Long-Short-range Adapter for Scaling End-to-End Temporal Action Localization
Temporal Action Localization (TAL) involves localizing and classifying action snippets in an untrimmed video.
Rule By Example: Harnessing Logical Rules for Explainable Hate Speech Detection
In this paper, we present Rule By Example (RBE): a novel exemplar-based contrastive learning approach for learning from logical rules for the task of textual content moderation.
Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality
There is a rapidly growing need for multimodal content moderation (CM) as more and more content on social media is multimodal in nature.
PivoTAL: Prior-Driven Supervision for Weakly-Supervised Temporal Action Localization
To address this, we present PivoTAL, Prior-driven Supervision for Weakly-supervised Temporal Action Localization, to approach WTAL from a localization-by-localization perspective by learning to localize the action snippets directly.
Weakly Supervised Action Localization
Weakly Supervised Temporal Action Localization
ProTeGe: Untrimmed Pretraining for Video Temporal Grounding by Video Temporal Grounding
We present ProTeGe as the first method to perform VTG-based untrimmed pretraining to bridge the gap between trimmed pretrained backbones and downstream VTG tasks.
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
It captures object motion in the video via a novel optical flow calibration module that fuses the segmentation mask with optical flow estimation to improve within-object optical flow smoothness and reduce noise at object boundaries.
Ranked #1 on
Video Object Segmentation
on DAVIS 2017 (test-dev)
(using extra training data)
GateHUB: Gated History Unit with Background Suppression for Online Action Detection
We present GateHUB, Gated History Unit with Background Suppression, that comprises a novel position-guided gated cross-attention mechanism to enhance or suppress parts of the history as per how informative they are for current frame prediction.
Ranked #1 on
Online Action Detection
on TVSeries
MUSE: Feature Self-Distillation with Mutual Information and Self-Information
Importantly, we argue and empirically demonstrate that MUSE, compared to other feature discrepancy functions, is a more functional proxy to introduce dependency and effectively improve the expressivity of all features in the knowledge distillation framework.
Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation
We present MetaUVFS as the first Unsupervised Meta-learning algorithm for Video Few-Shot action recognition.
BLT: Balancing Long-Tailed Datasets with Adversarially-Perturbed Images
Unfortunately, this imbalance enables a visual recognition system to perform well on head classes but poorly on tail classes.
Ranked #53 on
Long-tail Learning
on ImageNet-LT
On Adversarial Robustness: A Neural Architecture Search perspective
We show that NAS, which is popular for achieving SoTA accuracy, can provide adversarial accuracy as a free add-on without any form of adversarial training.
HyperSTAR: Task-Aware Hyperparameters for Deep Networks
To reduce HPO time, we present HyperSTAR (System for Task Aware Hyperparameter Recommendation), a task-aware method to warm-start HPO for deep neural networks.
Animating Face using Disentangled Audio Representations
All previous methods for audio-driven talking head generation assume the input audio to be clean with a neutral tone.
Interactive Image Generation Using Scene Graphs
We propose a method to generate an image incrementally based on a sequence of graphs of scene descriptions (scene-graphs).
Attentive Semantic Video Generation using Captions
This paper proposes a network architecture to perform variable length semantic video generation using captions.
Sync-DRAW: Automatic Video Generation using Deep Recurrent Attentive Architectures
This paper introduces a novel approach for generating videos called Synchronized Deep Recurrent Attentive Writer (Sync-DRAW).
