Search Results for author: Boris Ivanovic

Found 32 papers, 18 papers with code

InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds

no code implementations29 Mar 2024 Zhiwen Fan, Wenyan Cong, Kairun Wen, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang

This pre-processing is usually conducted via a Structure-from-Motion (SfM) pipeline, a procedure that can be slow and unreliable, particularly in sparse-view scenarios with insufficient matched features for accurate reconstruction.

Novel View Synthesis SSIM

Producing and Leveraging Online Map Uncertainty in Trajectory Prediction

1 code implementation25 Mar 2024 Xunjiang Gu, Guanyu Song, Igor Gilitschenski, Marco Pavone, Boris Ivanovic

High-definition (HD) maps have played an integral role in the development of modern autonomous vehicle (AV) stacks, albeit with high associated labeling and maintenance costs.

Trajectory Forecasting

Parallelized Spatiotemporal Binding

no code implementations26 Feb 2024 Gautam Singh, Yue Wang, Jiawei Yang, Boris Ivanovic, Sungjin Ahn, Marco Pavone, Tong Che

While modern best practices advocate for scalable architectures that support long-range interactions, object-centric models are yet to fully embrace these architectures.

Object

Driving Everywhere with Large Language Model Policy Adaptation

no code implementations8 Feb 2024 Boyi Li, Yue Wang, Jiageng Mao, Boris Ivanovic, Sushant Veer, Karen Leung, Marco Pavone

Adapting driving behavior to new environments, customs, and laws is a long-standing problem in autonomous driving, precluding the widespread deployment of autonomous vehicles (AVs).

Autonomous Driving Language Modelling +2

Reinforcement Learning with Human Feedback for Realistic Traffic Simulation

no code implementations1 Sep 2023 Yulong Cao, Boris Ivanovic, Chaowei Xiao, Marco Pavone

This works aims to address this by developing a framework that employs reinforcement learning with human preference (RLHF) to enhance the realism of existing traffic models.

reinforcement-learning

trajdata: A Unified Interface to Multiple Human Trajectory Datasets

2 code implementations NeurIPS 2023 Boris Ivanovic, Guanyu Song, Igor Gilitschenski, Marco Pavone

The field of trajectory forecasting has grown significantly in recent years, partially owing to the release of numerous large-scale, real-world human trajectory datasets for autonomous vehicles (AVs) and pedestrian motion tracking.

Autonomous Vehicles Motion Forecasting +1

Language Conditioned Traffic Generation

1 code implementation16 Jul 2023 Shuhan Tan, Boris Ivanovic, Xinshuo Weng, Marco Pavone, Philipp Kraehenbuehl

In this work, we turn to language as a source of supervision for dynamic traffic scene generation.

Language Modelling Large Language Model +1

Language-Guided Traffic Simulation via Scene-Level Diffusion

no code implementations10 Jun 2023 Ziyuan Zhong, Davis Rempe, Yuxiao Chen, Boris Ivanovic, Yulong Cao, Danfei Xu, Marco Pavone, Baishakhi Ray

Realistic and controllable traffic simulation is a core capability that is necessary to accelerate autonomous vehicle (AV) development.

Language Modelling Large Language Model

Partial-View Object View Synthesis via Filtered Inversion

no code implementations3 Apr 2023 Fan-Yun Sun, Jonathan Tremblay, Valts Blukis, Kevin Lin, Danfei Xu, Boris Ivanovic, Peter Karkus, Stan Birchfield, Dieter Fox, Ruohan Zhang, Yunzhu Li, Jiajun Wu, Marco Pavone, Nick Haber

At inference, given one or more views of a novel real-world object, FINV first finds a set of latent codes for the object by inverting the generative model from multiple initial seeds.

Object

DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles

no code implementations13 Dec 2022 Peter Karkus, Boris Ivanovic, Shie Mannor, Marco Pavone

To enable the joint optimization of AV stacks while retaining modularity, we present DiffStack, a differentiable and modular stack for prediction, planning, and control.

Autonomous Vehicles

Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning

2 code implementations23 Sep 2022 Boris Ivanovic, James Harrison, Marco Pavone

Learning-based behavior prediction methods are increasingly being deployed in real-world autonomous systems, e. g., in fleets of self-driving vehicles, which are beginning to commercially operate in major cities across the world.

Meta-Learning regression

BITS: Bi-level Imitation for Traffic Simulation

1 code implementation26 Aug 2022 Danfei Xu, Yuxiao Chen, Boris Ivanovic, Marco Pavone

We empirically validate our method, named Bi-level Imitation for Traffic Simulation (BITS), with scenarios from two large-scale driving datasets and show that BITS achieves balanced traffic simulation performance in realism, diversity, and long-horizon stability.

Autonomous Vehicles

ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning

1 code implementation CVPR 2022 Yuxiao Chen, Boris Ivanovic, Marco Pavone

In this work, we present ScePT, a policy planning-based trajectory prediction model that generates accurate, scene-consistent trajectory predictions suitable for autonomous system motion planning.

Motion Planning Trajectory Prediction

MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation

1 code implementation18 Oct 2021 Xinshuo Weng, Boris Ivanovic, Marco Pavone

Recently, there has been tremendous progress in developing each individual module of the standard perception-planning robot autonomy pipeline, including detection, tracking, prediction of other agents' trajectories, and ego-agent trajectory planning.

Trajectory Planning

Propagating State Uncertainty Through Trajectory Forecasting

1 code implementation7 Oct 2021 Boris Ivanovic, Yifeng Lin, Shubham Shrivastava, Punarjay Chakravarty, Marco Pavone

As a result, perceptual uncertainties are not propagated through forecasting and predictions are frequently overconfident.

Trajectory Forecasting

Injecting Planning-Awareness into Prediction and Detection Evaluation

1 code implementation7 Oct 2021 Boris Ivanovic, Marco Pavone

Detecting other agents and forecasting their behavior is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios entailing human-robot interaction such as autonomous driving.

Autonomous Driving Decision Making +1

Sample-Efficient Safety Assurances using Conformal Prediction

no code implementations28 Sep 2021 Rachel Luo, Shengjia Zhao, Jonathan Kuck, Boris Ivanovic, Silvio Savarese, Edward Schmerling, Marco Pavone

When deploying machine learning models in high-stakes robotics applications, the ability to detect unsafe situations is crucial.

Conformal Prediction Robotic Grasping

Rethinking Trajectory Forecasting Evaluation

no code implementations21 Jul 2021 Boris Ivanovic, Marco Pavone

Forecasting the behavior of other agents is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios with human-robot interaction, such as autonomous driving.

Autonomous Driving Decision Making +1

Leveraging Neural Network Gradients within Trajectory Optimization for Proactive Human-Robot Interactions

1 code implementation2 Dec 2020 Simon Schaefer, Karen Leung, Boris Ivanovic, Marco Pavone

To achieve seamless human-robot interactions, robots need to intimately reason about complex interaction dynamics and future human behaviors within their motion planning process.

Motion Planning Navigate +1

Evidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders

1 code implementation NeurIPS 2020 Masha Itkina, Boris Ivanovic, Ransalu Senanayake, Mykel J. Kochenderfer, Marco Pavone

Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual scene representation.

Image Generation Motion Planning +1

Risk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction

no code implementations12 Sep 2020 Haruki Nishimura, Boris Ivanovic, Adrien Gaidon, Marco Pavone, Mac Schwager

This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure.

Model Predictive Control Trajectory Forecasting

Multimodal Deep Generative Models for Trajectory Prediction: A Conditional Variational Autoencoder Approach

no code implementations10 Aug 2020 Boris Ivanovic, Karen Leung, Edward Schmerling, Marco Pavone

Human behavior prediction models enable robots to anticipate how humans may react to their actions, and hence are instrumental to devising safe and proactive robot planning algorithms.

Trajectory Prediction

The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs

1 code implementation ICCV 2019 Boris Ivanovic, Marco Pavone

Developing safe human-robot interaction systems is a necessary step towards the widespread integration of autonomous agents in society.

Decision Making Motion Forecasting +2

BaRC: Backward Reachability Curriculum for Robotic Reinforcement Learning

1 code implementation16 Jun 2018 Boris Ivanovic, James Harrison, Apoorva Sharma, Mo Chen, Marco Pavone

Our Backward Reachability Curriculum (BaRC) begins policy training from states that require a small number of actions to accomplish the task, and expands the initial state distribution backwards in a dynamically-consistent manner once the policy optimization algorithm demonstrates sufficient performance.

Continuous Control reinforcement-learning +1

Generative Modeling of Multimodal Multi-Human Behavior

1 code implementation6 Mar 2018 Boris Ivanovic, Edward Schmerling, Karen Leung, Marco Pavone

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i. e. where there are many possible highly-distinct futures).

Robotics Human-Computer Interaction

Cannot find the paper you are looking for? You can Submit a new open access paper.