Search Results for author:
Found 5 papers, 2 papers with code
PhotoBot: Reference-Guided Interactive Photography via Natural Language
We leverage a visual language model (VLM) and an object detector to characterize the reference images via textual descriptions and then use a large language model (LLM) to retrieve relevant reference images based on a user's language query through text-based reasoning.
Working Backwards: Learning to Place by Picking
By doing so, the policy can generalize to object placement scenarios outside of the training environment without privileged information (e. g., placing a plate picked up from a table).
Multimodal and Force-Matched Imitation Learning with a See-Through Visuotactile Sensor
An STS sensor can be switched between visual and tactile modes by leveraging a semi-transparent surface and controllable lighting, allowing for both pre-contact visual sensing and during-contact tactile sensing with a single sensor.
Learning Sequential Latent Variable Models from Multimodal Time Series Data
In this work, we present a self-supervised generative modelling framework to jointly learn a probabilistic latent state representation of multimodal data and the respective dynamics.
Heteroscedastic Uncertainty for Robust Generative Latent Dynamics
Learning or identifying dynamics from a sequence of high-dimensional observations is a difficult challenge in many domains, including reinforcement learning and control.
