Embodied Question Answering

8 papers with code • 0 benchmarks • 2 datasets

This task has no description! Would you like to contribute one?

Towards Learning a Generalist Model for Embodied Navigation

zd11024/NaviLLM 4 Dec 2023

We conduct extensive experiments to evaluate the performance and generalizability of our model.

61
04 Dec 2023

Synthesizing Event-centric Knowledge Graphs of Daily Activities Using Virtual Space

aistairc/virtualhome2kg 30 Jul 2023

Artificial intelligence (AI) is expected to be embodied in software agents, robots, and cyber-physical systems that can understand the various contextual information of daily life in the home environment to support human behavior and decision making in various situations.

8
30 Jul 2023

AllenAct: A Framework for Embodied AI Research

allenai/allenact 28 Aug 2020

The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased interest from the computer vision, NLP, and robotics communities.

294
28 Aug 2020

VideoNavQA: Bridging the Gap between Visual and Embodied Question Answering

catalina17/VideoNavQA 14 Aug 2019

The goal of this dataset is to assess question-answering performance from nearly-ideal navigation paths, while considering a much more complete variety of questions than current instantiations of the EQA task.

23
14 Aug 2019

Multi-Target Embodied Question Answering

facebookresearch/EmbodiedQA CVPR 2019

To address this, we propose a modular architecture composed of a program generator, a controller, a navigator, and a VQA module.

287
09 Apr 2019

Blindfold Baselines for Embodied QA

ankeshanand/blindfold-baselines-eqa 12 Nov 2018

We explore blindfold (question-only) baselines for Embodied Question Answering.

6
12 Nov 2018

Neural Modular Control for Embodied Question Answering

facebookresearch/House3D 26 Oct 2018

We use imitation learning to warm-start policies at each level of the hierarchy, dramatically increasing sample efficiency, followed by reinforcement learning.

1,177
26 Oct 2018

Embodied Question Answering

facebookresearch/House3D CVPR 2018

We present a new AI task -- Embodied Question Answering (EmbodiedQA) -- where an agent is spawned at a random location in a 3D environment and asked a question ("What color is the car?").

1,177
30 Nov 2017