no code implementations • 14 Nov 2022 • Sagar Gubbi Venkatesh, Partha Talukdar, Srini Narayanan
We compare the performance of different LLMs including PaLM and GPT-3 and find that the end-to-end task completion rate is 48% for English UI but the performance drops to 32% for other languages.
no code implementations • 26 Dec 2020 • Sagar Gubbi Venkatesh, Anirban Biswas, Raviteja Upadrashta, Vikram Srinivasan, Partha Talukdar, Bharadwaj Amrutur
Robots that can manipulate objects in unstructured environments and collaborate with humans can benefit immensely by understanding natural language.
no code implementations • 26 Dec 2020 • Sagar Gubbi Venkatesh, Bharadwaj Amrutur
A robot that can operate in novel and unstructured environments must be capable of recognizing new, previously unseen, objects.
no code implementations • 26 Dec 2020 • Sagar Gubbi Venkatesh, Raviteja Upadrashta, Bharadwaj Amrutur
It is highly desirable for robots that work alongside humans to be able to understand instructions in natural language.
no code implementations • 26 Dec 2020 • Sagar Gubbi Venkatesh, Raviteja Upadrashta, Shishir Kolathaya, Bharadwaj Amrutur
Existing architectures for imitation learning using image-to-action policy networks perform poorly when presented with an input image containing multiple instances of the object of interest, especially when the number of expert demonstrations available for training are limited.
no code implementations • 26 Dec 2020 • Sagar Gubbi Venkatesh, Nihesh Rathod, Shishir Kolathaya, Bharadwaj Amrutur
Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions.
no code implementations • 25 Dec 2020 • Sagar Gubbi Venkatesh, Raviteja Upadrashta, Shishir Kolathaya, Bharadwaj Amrutur
Robots that must operate in novel environments and collaborate with humans must be capable of acquiring new knowledge from human experts during operation.