Search Results for author:
Found 6 papers, 3 papers with code
Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller
Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream.
Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks
In particular, InstDiffEdit aims to employ the cross-modal attention ability of existing diffusion models to achieve instant mask guidance during the diffusion steps.
Beyond First Impressions: Integrating Joint Multi-modal Cues for Comprehensive 3D Representation
Insufficient synergy neglects the idea that a robust 3D representation should align with the joint vision-language space, rather than independently aligning with each modality.
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
In this paper, we present an end-to-end framework Structure-CLIP, which integrates Scene Graph Knowledge (SGK) to enhance multi-modal structured representations.
Alpha at SemEval-2021 Task 6: Transformer Based Propaganda Classification
This paper describes our system participated in Task 6 of SemEval-2021: the task focuses on multimodal propaganda technique classification and it aims to classify given image and text into 22 classes.
ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graph
Thus, ERNIE-ViL can learn the joint representations characterizing the alignments of the detailed semantics across vision and language.
Ranked #2 on
Visual Question Answering (VQA)
on VCR (QA-R) test
