Search Results for author:
Found 9 papers, 6 papers with code
pix2gestalt: Amodal Segmentation by Synthesizing Wholes
We introduce pix2gestalt, a framework for zero-shot amodal segmentation, which learns to estimate the shape and appearance of whole objects that are only partially visible behind occlusions.
ViperGPT: Visual Inference via Python Execution for Reasoning
Answering visual queries is a complex task that requires both visual processing and reasoning.
Ranked #10 on
Zero-Shot Video Question Answer
on NExT-QA
FLEX: Full-Body Grasping Without Full-Body Grasps
Towards this goal, we address the task of generating a virtual human -- hands and full body -- grasping everyday objects.
Representing Spatial Trajectories as Distributions
We introduce a representation learning framework for spatial trajectories.
Learning the Predictability of the Future
We introduce a framework for learning from unlabeled video what is predictable in the future.
Representation Learning
Self-Supervised Action Recognition
+1
Globetrotter: Connecting Languages by Connecting Images
Machine translation between many languages at once is highly challenging, since training with ground truth requires supervision between all language pairs, which is difficult to obtain.
Learning to Learn Words from Visual Scenes
Language acquisition is the process of learning words from the surrounding scene.
Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
In this paper, we explore neural network models that learn to associate segments of spoken audio captions with the semantically relevant portions of natural images that they refer to.
Overcoming catastrophic forgetting with hard attention to the task
In this paper, we propose a task-based hard attention mechanism that preserves previous tasks' information without affecting the current task's learning.
Ranked #2 on
Continual Learning
on 20Newsgroup (10 tasks)
