HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language

no code implementations • 28 May 2023 • Shantipriya Parida, Idris Abdulmumin, Shamsuddeen Hassan Muhammad, Aneesh Bose, Guneet Singh Kohli, Ibrahim Said Ahmad, Ketan Kotwal, Sayan Deb Sarkar, Ondřej Bojar, Habeebah Adamu Kakudi

This paper presents HaVQA, the first multimodal dataset for visual question-answering (VQA) tasks in the Hausa language.

Multimodal Machine Translation Question Answering +2

SGAligner : 3D Scene Alignment with Scene Graphs

1 code implementation • 28 Apr 2023 • Sayan Deb Sarkar, Ondrej Miksik, Marc Pollefeys, Daniel Barath, Iro Armeni

We propose SGAligner, the first method for aligning pairs of 3D scene graphs that is robust to in-the-wild scenarios (ie, unknown overlap -- if any -- and changes in the environment).

3D Scene Graph Alignment Contrastive Learning +2

SGAligner: 3D Scene Alignment with Scene Graphs

no code implementations • ICCV 2023 • Sayan Deb Sarkar, Ondrej Miksik, Marc Pollefeys, Daniel Barath, Iro Armeni

We propose SGAligner, the first method for aligning pairs of 3D scene graphs that is robust to in-the-wild scenarios (i. e., unknown overlap - if any - and changes in the environment).

Contrastive Learning Knowledge Graphs

HO-3D_v3: Improving the Accuracy of Hand-Object Annotations of the HO-3D Dataset

1 code implementation • 2 Jul 2021 • Shreyas Hampali, Sayan Deb Sarkar, Vincent Lepetit

HO-3D is a dataset providing image sequences of various hand-object interaction scenarios annotated with the 3D pose of the hand and the object and was originally introduced as HO-3D_v2.

Object

Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation

1 code implementation • CVPR 2022 • Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, Vincent Lepetit

We propose a robust and accurate method for estimating the 3D poses of two hands in close interaction from a single color image.

3D Interacting Hand Pose Estimation 3D Pose Estimation +1

Monte Carlo Scene Search for 3D Scene Understanding

2 code implementations • CVPR 2021 • Shreyas Hampali, Sinisa Stekovic, Sayan Deb Sarkar, Chetan Srinivasa Kumar, Friedrich Fraundorfer, Vincent Lepetit

We explore how a general AI algorithm can be used for 3D scene understanding to reduce the need for training data.

Scene Understanding

General 3D Room Layout from a Single View by Render-and-Compare

1 code implementation • ECCV 2020 • Sinisa Stekovic, Shreyas Hampali, Mahdi Rad, Sayan Deb Sarkar, Friedrich Fraundorfer, Vincent Lepetit

In order to deal with occlusions between components of the layout, which is a problem ignored by previous works, we introduce an analysis-by-synthesis method to iteratively refine the 3D layout estimate.