Search Results for author:
Found 6 papers, 2 papers with code
Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models
Multimodal Large Language Models (MLLMs) have showcased impressive skills in tasks related to visual understanding and reasoning.
Ranked #68 on
Visual Question Answering
on MM-Vet
Language-Conditioned Robotic Manipulation with Fast and Slow Thinking
The language-conditioned robotic manipulation aims to transfer natural language instructions into executable actions, from simple pick-and-place to tasks requiring intent recognition and visual reasoning.
Object-Centric Instruction Augmentation for Robotic Manipulation
Humans interpret scenes by recognizing both the identities and positions of objects in their observations.
LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model
In this paper, we introduce LLaVA-$\phi$ (LLaVA-Phi), an efficient multi-modal assistant that harnesses the power of the recently advanced small language model, Phi-2, to facilitate multi-modal dialogues.
Ranked #81 on
Visual Question Answering
on MM-Vet
SpeechAct: Towards Generating Whole-body Motion from Speech
Then, we regress the motion representation from the audio signal by a translation model employing our contrastive motion learning method.
Enhancing Asynchronous Time Series Forecasting with Contrastive Relational Inference
Asynchronous time series, also known as temporal event sequences, are the basis of many applications throughout different industries.
