Browse SoTA > Reasoning > Visual Reasoning

Visual Reasoning

35 papers with code · Reasoning

Benchmarks

Latest papers with code

Learning to Discretely Compose Reasoning Module Networks for Video Captioning

17 Jul 2020tgc1997/RMN

However, existing visual reasoning methods designed for visual question answering are not appropriate to video captioning, for it requires more complex visual reasoning on videos over both space and time, and dynamic module composition along the generation process.

QUESTION ANSWERING VIDEO CAPTIONING VISUAL QUESTION ANSWERING VISUAL REASONING

23
17 Jul 2020

Attention-Based Context Aware Reasoning for Situation Recognition

CVPR 2020 thilinicooray/context-aware-reasoning-for-sr

However, existing query-based reasoning methods have not considered handling of inter-dependent queries which is a unique requirement of semantic role prediction in SR.

FINE-GRAINED ACTION RECOGNITION QUESTION ANSWERING VISUAL QUESTION ANSWERING VISUAL REASONING

3
01 Jun 2020

Cross-Modality Relevance for Reasoning on Language and Vision

ACL 2020 HLR/Cross_Modality_Relevance

This work deals with the challenge of learning and reasoning over language and vision data for the related downstream tasks such as visual question answering (VQA) and natural language for visual reasoning (NLVR).

QUESTION ANSWERING VISUAL QUESTION ANSWERING VISUAL REASONING

11
12 May 2020

Dynamic Language Binding in Relational Visual Reasoning

30 Apr 2020thaolmk54/LOGNet-VQA

We present Language-binding Object Graph Network, the first neural reasoning method with dynamic relational structures across both visual and textual domains with applications in visual question answering.

QUESTION ANSWERING VISUAL QUESTION ANSWERING VISUAL REASONING

2
30 Apr 2020

Differentiable Adaptive Computation Time for Visual Reasoning

CVPR 2020 ceyzaguirre4/DACT-MAC

This paper presents a novel attention-based algorithm for achieving adaptive computation called DACT, which, unlike existing ones, is end-to-end differentiable.

VISUAL REASONING

9
27 Apr 2020

Hierarchical Rule Induction Network for Abstract Visual Reasoning

17 Feb 2020husheng12345/RPM

Abstract reasoning refers to the ability to analyze information, discover rules at an intangible level, and solve problems in innovative ways.

RELATION EXTRACTION VISUAL REASONING

4
17 Feb 2020

Weakly Supervised Visual Semantic Parsing

CVPR 2020 alirezazareian/vspnet

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retrieval.

GRAPH GENERATION IMAGE RETRIEVAL SCENE GRAPH GENERATION SEMANTIC PARSING VISUAL REASONING

19
08 Jan 2020

Smart Home Appliances: Chat with Your Fridge

19 Dec 2019gudovskiy/fridge-demo

Current home appliances are capable to execute a limited number of voice commands such as turning devices on or off, adjusting music volume or light conditions.

VISUAL REASONING

2
19 Dec 2019

Temporal Reasoning via Audio Question Answering

21 Nov 2019facebookresearch/daqa

In this paper, we use the task of Audio Question Answering (AQA) to study the temporal reasoning abilities of machine learning models.

AUDIO QUESTION ANSWERING QUESTION ANSWERING READING COMPREHENSION VISUAL QUESTION ANSWERING VISUAL REASONING

11
21 Nov 2019

CLEVRER: CoLlision Events for Video REpresentation and Reasoning

ICLR 2020 chuangg/CLEVRER

While these models thrive on the perception-based task (descriptive), they perform poorly on the causal tasks (explanatory, predictive and counterfactual), suggesting that a principled approach for causal reasoning should incorporate the capability of both perceiving complex visual and language inputs, and understanding the underlying dynamics and causal relations.

VISUAL REASONING

20
03 Oct 2019