Search Results for author: Dmitry Berenson

Found 22 papers, 6 papers with code

Constrained Stein Variational Trajectory Optimization

no code implementations23 Aug 2023 Thomas Power, Dmitry Berenson

We present Constrained Stein Variational Trajectory Optimization (CSVTO), an algorithm for performing trajectory optimization with constraints on a set of trajectories in parallel.

Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedback

no code implementations23 May 2023 Mark Van der Merwe, Youngsun Wi, Dmitry Berenson, Nima Fazeli

Representing the object geometry and contact with the environment implicitly allows a single model to predict contact patches of varying complexity.

Object

CHSEL: Producing Diverse Plausible Pose Estimates from Contact and Free Space Data

1 code implementation14 May 2023 Sheng Zhong, Nima Fazeli, Dmitry Berenson

Rather than attempting to estimate the true pose of the object, which is not tractable without a large number of contacts, we seek to estimate a plausible set of poses which obey the constraints imposed by the sensor data.

Pose Estimation

Data-Efficient Learning of Natural Language to Linear Temporal Logic Translators for Robot Task Specification

1 code implementation9 Mar 2023 Jiayi Pan, Glen Chou, Dmitry Berenson

We evaluate our approach on three existing LTL/natural language datasets and show that we can translate natural language commands at 75\% accuracy with far less human data ($\le$12 annotations).

Safe Output Feedback Motion Planning from Images via Learned Perception Modules and Contraction Theory

no code implementations14 Jun 2022 Glen Chou, Necmiye Ozay, Dmitry Berenson

We present a motion planning algorithm for a class of uncertain control-affine nonlinear systems which guarantees runtime safety and goal reachability when using high-dimensional sensor measurements (e. g., RGB-D images) and a learned perception module in the feedback control loop.

Motion Planning valid

Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projection

no code implementations10 May 2022 Thomas Power, Dmitry Berenson

We propose a Model Predictive Control (MPC) method for collision-free navigation that uses amortized variational inference to approximate the distribution of optimal control sequences by training a normalizing flow conditioned on the start, goal and environment.

Model Predictive Control Variational Inference

Gaussian Process Constraint Learning for Scalable Chance-Constrained Motion Planning from Demonstrations

no code implementations8 Dec 2021 Glen Chou, Hao Wang, Dmitry Berenson

We propose a method for learning constraints represented as Gaussian processes (GPs) from locally-optimal demonstrations.

Gaussian Processes Motion Planning

Model Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systems

no code implementations18 Apr 2021 Glen Chou, Necmiye Ozay, Dmitry Berenson

We derive a trajectory tracking error bound for a contraction-based controller that is subjected to this model error, and then learn a controller that optimizes this tracking bound.

Deformable Object Manipulation Motion Planning +1

Fusing RGBD Tracking and Segmentation Tree Sampling for Multi-Hypothesis Volumetric Segmentation

1 code implementation1 Apr 2021 Andrew Price, Kun Huang, Dmitry Berenson

In this work, we propose Multihypothesis Segmentation Tracking (MST), a novel method for volumetric segmentation in changing scenes, which allows scene ambiguity to be tracked and our estimates to be adjusted over time as we interact with the scene.

Scene Segmentation Segmentation

Keep it Simple: Data-efficient Learning for Controlling Complex Systems with Simple Models

no code implementations4 Feb 2021 Thomas Power, Dmitry Berenson

We use these images to train a perception model that estimates the simple model state from observations of the complex system online.

Model Predictive Control

Diverse Plausible Shape Completions from Ambiguous Depth Images

1 code implementation18 Nov 2020 Brad Saund, Dmitry Berenson

We propose PSSNet, a network architecture for generating diverse plausible 3D reconstructions from a single 2. 5D depth image.

Decoder

Tracking Partially-Occluded Deformable Objects while Enforcing Geometric Constraints

1 code implementation1 Nov 2020 YiXuan Wang, Dale McConachie, Dmitry Berenson

In order to manipulate a deformable object, such as rope or cloth, in unstructured environments, robots need a way to estimate its current shape.

Object

TAMPC: A Controller for Escaping Traps in Novel Environments

1 code implementation23 Oct 2020 Sheng Zhong, Zhenyuan Zhang, Nima Fazeli, Dmitry Berenson

We propose an approach to online model adaptation and control in the challenging case of hybrid and discontinuous dynamics where actions may lead to difficult-to-escape "trap" states, under a given controller.

Model Predictive Control

Planning with Learned Dynamics: Probabilistic Guarantees on Safety and Reachability via Lipschitz Constants

no code implementations18 Oct 2020 Craig Knuth, Glen Chou, Necmiye Ozay, Dmitry Berenson

Our method imposes the feedback law existence as a constraint in a sampling-based planner, which returns a feedback policy around a nominal plan ensuring that, if the Lipschitz constant estimate is valid, the true system is safe during plan execution, reaches the goal, and is ultimately invariant in a small set about the goal.

Motion Planning valid

Explaining Multi-stage Tasks by Learning Temporal Logic Formulas from Suboptimal Demonstrations

no code implementations3 Jun 2020 Glen Chou, Necmiye Ozay, Dmitry Berenson

We present a method for learning multi-stage tasks from demonstrations by learning the logical structure and atomic propositions of a consistent linear temporal logic (LTL) formula.

Learning Constraints from Locally-Optimal Demonstrations under Cost Function Uncertainty

no code implementations25 Jan 2020 Glen Chou, Necmiye Ozay, Dmitry Berenson

We present an algorithm for learning parametric constraints from locally-optimal demonstrations, where the cost function being optimized is uncertain to the learner.

Learning Parametric Constraints in High Dimensions from Demonstrations

no code implementations8 Oct 2019 Glen Chou, Necmiye Ozay, Dmitry Berenson

We present a scalable algorithm for learning parametric constraints in high dimensions from safe expert demonstrations.

Vocal Bursts Intensity Prediction

Inferring Occluded Geometry Improves Performance when Retrieving an Object from Dense Clutter

no code implementations20 Jul 2019 Andrew Price, Linyi Jin, Dmitry Berenson

Object search -- the problem of finding a target object in a cluttered scene -- is essential to solve for many robotics applications in warehouse and household environments.

Object

Learning Constraints from Demonstrations

no code implementations17 Dec 2018 Glen Chou, Dmitry Berenson, Necmiye Ozay

We also provide theoretical analysis on what subset of the constraint can be learnable from safe demonstrations.

Bandit-Based Model Selection for Deformable Object Manipulation

no code implementations29 Mar 2017 Dale McConachie, Dmitry Berenson

The key contribution of this paper is to formulate the task as a Multi-Armed Bandit problem, with each arm representing a model of the deformable object.

Deformable Object Manipulation Model Selection +1

Analysis and Observations from the First Amazon Picking Challenge

no code implementations21 Jan 2016 Nikolaus Correll, Kostas E. Bekris, Dmitry Berenson, Oliver Brock, Albert Causo, Kris Hauser, Kei Okada, Alberto Rodriguez, Joseph M. Romano, Peter R. Wurman

This paper presents a overview of the inaugural Amazon Picking Challenge along with a summary of a survey conducted among the 26 participating teams.

Robotics

Cannot find the paper you are looking for? You can Submit a new open access paper.