Search Results for author: Robert Platt

Found 34 papers, 19 papers with code

Noise2Noise Denoising of CRISM Hyperspectral Data

1 code implementation26 Mar 2024 Robert Platt, Rossella Arcucci, Cédric John

Hyperspectral data acquired by the Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) have allowed for unparalleled mapping of the surface mineralogy of Mars.

Denoising

Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D

no code implementations22 Jan 2024 Haojie Huang, Owen Howell, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt

Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions.

Leveraging Symmetries in Pick and Place

no code implementations15 Aug 2023 Haojie Huang, Dian Wang, Arsh Tangri, Robin Walters, Robert Platt

This paper analytically studies the symmetries present in planar robotic pick and place and proposes a method of incorporating equivariant neural models into Transporter Net in a way that captures all symmetries.

Imitation Learning

On Robot Grasp Learning Using Equivariant Models

1 code implementation10 Jun 2023 Xupeng Zhu, Dian Wang, Guanang Su, Ondrej Biza, Robin Walters, Robert Platt

Real-world grasp detection is challenging due to the stochasticity in grasp dynamics and the noise in hardware.

Inductive Bias

Image to Sphere: Learning Equivariant Features for Efficient Pose Prediction

1 code implementation27 Feb 2023 David M. Klee, Ondrej Biza, Robert Platt, Robin Walters

Predicting the pose of objects from a single image is an important but difficult computer vision problem.

Pose Prediction

The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry

no code implementations16 Nov 2022 Dian Wang, Jung Yeon Park, Neel Sortur, Lawson L. S. Wong, Robin Walters, Robert Platt

Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture.

Inductive Bias

Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection

no code implementations31 Oct 2022 Haojie Huang, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt

Given point cloud input, the problem of 6-DoF grasp pose detection is to identify a set of hand poses in SE(3) from which an object can be successfully grasped.

Image to Icosahedral Projection for $\mathrm{SO}(3)$ Object Reasoning from Single-View Images

no code implementations18 Jul 2022 David Klee, Ondrej Biza, Robert Platt, Robin Walters

In this paper, we propose a novel architecture based on icosahedral group convolutions that reasons in $\mathrm{SO(3)}$ by learning a projection of the input image onto an icosahedron.

Object Pose Estimation

Visual Foresight With a Local Dynamics Model

1 code implementation29 Jun 2022 Colin Kohler, Robert Platt

By combining the LDM with model-free policy learning, we can learn policies which can solve complex manipulation tasks using one-step lookahead planning.

Deep Transformer Q-Networks for Partially Observable Reinforcement Learning

1 code implementation2 Jun 2022 Kevin Esslinger, Robert Platt, Christopher Amato

Such tasks typically require some form of memory, where the agent has access to multiple past observations, in order to perform well.

Partially Observable Reinforcement Learning reinforcement-learning +1

Binding Actions to Objects in World Models

1 code implementation27 Apr 2022 Ondrej Biza, Robert Platt, Jan-Willem van de Meent, Lawson L. S. Wong, Thomas Kipf

We study the problem of binding actions to objects in object-factored world models using action-attention mechanisms.

Hard Attention Object

Factored World Models for Zero-Shot Generalization in Robotic Manipulation

1 code implementation10 Feb 2022 Ondrej Biza, Thomas Kipf, David Klee, Robert Platt, Jan-Willem van de Meent, Lawson L. S. Wong

In this paper, we learn to generalize over robotic pick-and-place tasks using object-factored world models, which combat the combinatorial explosion by ensuring that predictions are equivariant to permutations of objects.

Object Zero-shot Generalization

GASCN: Graph Attention Shape Completion Network

no code implementations20 Jan 2022 Haojie Huang, ZiYi Yang, Robert Platt

Shape completion, the problem of inferring the complete geometry of an object given a partial point cloud, is an important problem in robotics and computer vision.

Graph Attention

Equivariant Grasp learning In Real Time

no code implementations29 Sep 2021 Xupeng Zhu, Dian Wang, Ondrej Biza, Robert Platt

Visual grasp detection is a key problem in robotics where the agent must learn to model the grasp function, a mapping from an image of a scene onto a set of feasible grasp poses.

Action Priors for Large Action Spaces in Robotics

1 code implementation11 Jan 2021 Ondrej Biza, Dian Wang, Robert Platt, Jan-Willem van de Meent, Lawson L. S. Wong

This paper proposes an alternative approach where the solutions of previously solved tasks are used to produce an action prior that can facilitate exploration in future tasks.

reinforcement-learning Reinforcement Learning (RL) +2

Belief-Grounded Networks for Accelerated Robot Learning under Partial Observability

1 code implementation19 Oct 2020 Hai Nguyen, Brett Daley, Xinchao Song, Christopher Amato, Robert Platt

Many important robotics problems are partially observable in the sense that a single visual or force-feedback measurement is insufficient to reconstruct the state.

Robotic Pick-and-Place With Uncertain Object Instance Segmentation and Shape Completion

1 code implementation15 Oct 2020 Marcus Gualtieri, Robert Platt

One approach is (a) use object instance segmentation and shape completion to model the objects and (b) use a regrasp planner to decide grasps and places displacing the models to their goals.

Robotics

Learning visual servo policies via planner cloning

no code implementations24 May 2020 Ulrich Viereck, Kate Saenko, Robert Platt

Learning control policies for visual servoing in novel environments is an important problem.

Learning Manipulation Skills Via Hierarchical Spatial Attention

1 code implementation19 Apr 2019 Marcus Gualtieri, Robert Platt

Learning generalizable skills in robotic manipulation has long been challenging due to real-world sized observation and action spaces.

Robotics

Online Abstraction with MDP Homomorphisms for Deep Learning

1 code implementation30 Nov 2018 Ondrej Biza, Robert Platt

Abstraction of Markov Decision Processes is a useful tool for solving complex problems, as it can ignore unimportant aspects of an environment, simplifying the process of learning an optimal policy.

AutOTranS: an Autonomous Open World Transportation System

no code implementations8 Oct 2018 Brayan S. Zapata-Impata, Vikrant Shah, Hanumant Singh, Robert Platt

Tasks in outdoor open world environments are now ripe for automation with mobile manipulators.

Robotics

Exploiting Environmental Variation to Improve Policy Robustness in Reinforcement Learning

no code implementations27 Sep 2018 Siddharth Mysore, Robert Platt, Kate Saenko

We propose a novel method to exploit this observation to develop robust actor policies, by automatically developing a sampling curriculum over environment settings to use in training.

reinforcement-learning Reinforcement Learning (RL)

Adapting control policies from simulation to reality using a pairwise loss

no code implementations27 Jul 2018 Ulrich Viereck, Xingchao Peng, Kate Saenko, Robert Platt

This paper proposes an approach to domain transfer based on a pairwise loss function that helps transfer control policies learned in simulation onto a real robot.

Learning 6-DoF Grasping and Pick-Place Using Attention Focus

1 code implementation15 Jun 2018 Marcus Gualtieri, Robert Platt

We address a class of manipulation problems where the robot perceives the scene with a depth sensor and can move its end effector in a space with six degrees of freedom -- 3D position and orientation.

Robotics

Learning Multi-Level Hierarchies with Hindsight

4 code implementations4 Dec 2017 Andrew Levy, George Konidaris, Robert Platt, Kate Saenko

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only require short sequences of decisions.

Decision Making Hierarchical Reinforcement Learning

Pick and Place Without Geometric Object Models

1 code implementation18 Jul 2017 Marcus Gualtieri, Andreas ten Pas, Robert Platt

Whereas most deep RL approaches to robotic manipulation frame the problem in terms of low level states and actions, we propose a more abstract formulation.

Robotics

Grasp Pose Detection in Point Clouds

1 code implementation29 Jun 2017 Andreas ten Pas, Marcus Gualtieri, Kate Saenko, Robert Platt

Many grasp detection methods achieve grasp success rates (grasp successes as a fraction of the total number of grasp attempts) between 75% and 95% for novel objects presented in isolation or in light clutter.

Robotics

Learning a visuomotor controller for real world robotic grasping using simulated depth images

no code implementations14 Jun 2017 Ulrich Viereck, Andreas ten Pas, Kate Saenko, Robert Platt

This paper proposes an approach to learning a closed-loop controller for robotic grasping that dynamically guides the gripper to the object.

Robotic Grasping

High precision grasp pose detection in dense clutter

3 code implementations4 Mar 2016 Marcus Gualtieri, Andreas ten Pas, Kate Saenko, Robert Platt

Our focus in this paper is on improving the second step by using depth sensor scans from large online datasets to train a convolutional neural network.

Robotics

Using Geometry to Detect Grasps in 3D Point Clouds

no code implementations13 Jan 2015 Andreas ten Pas, Robert Platt

Overall, our method achieves an average grasp success rate of 88% when grasping novels objects presented in isolation and an average success rate of 73% when grasping novel objects presented in dense clutter.

Robotics

Cannot find the paper you are looking for? You can Submit a new open access paper.