Search Results for author:
Found 8 papers, 4 papers with code
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models
Nevertheless, the frozen visual encoder in autoregressive VLMs imposes constraints on the learning of conventional image triggers.
GSVA: Generalized Segmentation via Multimodal Large Language Models
Generalized Referring Expression Segmentation (GRES) extends the scope of classic RES to refer to multiple objects in one expression or identify the empty targets absent in the image.
Generalized Referring Expression Segmentation
Referring Expression
+1
Agent Attention: On the Integration of Softmax and Linear Attention
Specifically, the Agent Attention, denoted as a quadruple $(Q, A, K, V)$, introduces an additional set of agent tokens $A$ into the conventional attention module.
OT-Attack: Enhancing Adversarial Transferability of Vision-Language Models via Optimal Transport Optimization
Investigating the generation of high-transferability adversarial examples is crucial for uncovering VLP models' vulnerabilities in practical scenarios.
FLatten Transformer: Vision Transformer using Focused Linear Attention
The quadratic computation complexity of self-attention has been a persistent challenge when applying Transformer models to vision tasks.
Dynamic Perceiver for Efficient Visual Recognition
Early exits are placed exclusively within the classification branch, thus eliminating the need for linear separability in low-level features.
Contrastive Language-Image Pre-Training with Knowledge Graphs
Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising performances when transferred to downstream tasks.
Pseudo-Q: Generating Pseudo Language Queries for Visual Grounding
Our method leverages an off-the-shelf object detector to identify visual objects from unlabeled images, and then language queries for these objects are obtained in an unsupervised fashion with a pseudo-query generation module.
