Search Results for author:
Found 5 papers, 3 papers with code
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
Recently, open-source LLVMs have curated high-quality visual instruction tuning datasets and utilized additional vision encoders or multiple computer vision models in order to narrow the performance gap with powerful closed-source LLVMs.
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Therefore, we present a new LLVM, Mixture of All Intelligence (MoAI), which leverages auxiliary visual information obtained from the outputs of external segmentation, detection, SGG, and OCR models.
Ranked #27 on
Visual Question Answering
on MM-Vet
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation
We devise completeness loss and consistency loss based on semantic similarity scores.
CoLLaVO: Crayon Large Language and Vision mOdel
Our findings reveal that the image understanding capabilities of current VLMs are strongly correlated with their zero-shot performance on vision language (VL) tasks.
Ranked #35 on
Visual Question Answering
on MM-Vet
Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video
The proposed DVFA can align the input transcription (i. e., sentence) with the talking face video without accessing the speech audio.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
