Search Results for author:
Found 5 papers, 1 papers with code
Tactile-Augmented Radiance Fields
Our approach makes use of two insights: (i) common vision-based touch sensors are built on ordinary cameras and thus can be registered to images using methods from multi-view geometry, and (ii) visually and structurally similar regions of a scene share the same tactile features.
Binding Touch to Everything: Learning Unified Multimodal Tactile Representations
We introduce UniTouch, a unified tactile model for vision-based touch sensors connected to multiple modalities, including vision, language, and sound.
The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects
We introduce the ObjectFolder Benchmark, a benchmark suite of 10 tasks for multisensory object-centric learning, centered around object recognition, reconstruction, and manipulation with sight, sound, and touch.
From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding
By aligning the classes of previous datasets to our semantic space, we gather (image/video/skeleton/MoCap) datasets into a unified database in a unified label system, i. e., bridging "isolated islands" into a "Pangea".
Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactions
In daily HOIs, humans often interact with a variety of objects, e. g., holding and touching dozens of household items in cleaning.
