Search Results for author: Andreas Geiger

Found 120 papers, 65 papers with code

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

no code implementations26 Mar 2024 Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao

3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking.

Novel View Synthesis

SLEDGE: Synthesizing Simulation Environments for Driving Agents with Generative Models

no code implementations26 Mar 2024 Kashyap Chitta, Daniel Dauner, Andreas Geiger

SLEDGE is the first generative simulator for vehicle motion planning trained on real-world driving logs.

Motion Planning

Renovating Names in Open-Vocabulary Segmentation Benchmarks

no code implementations14 Mar 2024 Haiwen Huang, Songyou Peng, Dan Zhang, Andreas Geiger

We further demonstrate that using our renovated names enables training of stronger open-vocabulary segmentation models.

Segmentation

LISO: Lidar-only Self-Supervised 3D Object Detection

no code implementations11 Mar 2024 Stefan Baur, Frank Moosmann, Andreas Geiger

3D object detection is one of the most important components in any Self-Driving stack, but current state-of-the-art (SOTA) lidar object detectors require costly & slow manual annotation of 3D bounding boxes to perform well.

3D Object Detection Object +2

Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesis

no code implementations19 Feb 2024 Christian Reiser, Stephan Garbin, Pratul P. Srinivasan, Dor Verbin, Richard Szeliski, Ben Mildenhall, Jonathan T. Barron, Peter Hedman, Andreas Geiger

Third, we minimize the binary entropy of the opacity values, which facilitates the extraction of surface geometry by encouraging opacity values to binarize towards the end of training.

DriveLM: Driving with Graph Visual Question Answering

1 code implementation21 Dec 2023 Chonghao Sima, Katrin Renz, Kashyap Chitta, Li Chen, Hanxue Zhang, Chengen Xie, Ping Luo, Andreas Geiger, Hongyang Li

The experiments demonstrate that Graph VQA provides a simple, principled framework for reasoning about a driving scene, and DriveLM-Data provides a challenging benchmark for this task.

Autonomous Driving Question Answering +1

NeLF-Pro: Neural Light Field Probes

no code implementations20 Dec 2023 Zinuo You, Andreas Geiger, Anpei Chen

We present NeLF-Pro, a novel representation for modeling and reconstructing light fields in diverse natural scenes that vary in extend and spatial granularity.

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

1 code implementation14 Dec 2023 Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang

In this paper, we use 3D Gaussian Splatting and learn a non-rigid deformation network to reconstruct animatable clothed human avatars that can be trained within 30 minutes and rendered at real-time frame rates (50+ FPS).

Image Generation

An Invitation to Deep Reinforcement Learning

no code implementations13 Dec 2023 Bernhard Jaeger, Andreas Geiger

These networks can be optimized with supervised learning, if the target objective is differentiable.

Code Generation object-detection +3

IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing

no code implementations8 Dec 2023 Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang

We present IntrinsicAvatar, a novel approach to recovering the intrinsic properties of clothed human avatars including geometry, albedo, material, and environment lighting from only monocular videos.

Disentanglement Inverse Rendering +1

MuRF: Multi-Baseline Radiance Fields

1 code implementation7 Dec 2023 Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

We present Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view synthesis under multiple different baseline settings (small and large baselines, and different number of input views).

Zero-shot Generalization

GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs

no code implementations30 Nov 2023 Gege Gao, Weiyang Liu, Anpei Chen, Andreas Geiger, Bernhard Schölkopf

As pretrained text-to-image diffusion models become increasingly powerful, recent efforts have been made to distill knowledge from these text-to-image pretrained models for optimizing a text-guided 3D model.

Mip-Splatting: Alias-free 3D Gaussian Splatting

no code implementations27 Nov 2023 Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger

Recently, 3D Gaussian Splatting has demonstrated impressive novel view synthesis results, reaching high fidelity and efficiency.

Novel View Synthesis

WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space

no code implementations22 Nov 2023 Katja Schwarz, Seung Wook Kim, Jun Gao, Sanja Fidler, Andreas Geiger, Karsten Kreis

Then, we train a diffusion model in the 3D-aware latent space, thereby enabling synthesis of high-quality 3D-consistent image samples, outperforming recent state-of-the-art GAN-based methods.

3D-Aware Image Synthesis Depth Estimation +2

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers

1 code implementation16 Oct 2023 Takeru Miyato, Bernhard Jaeger, Max Welling, Andreas Geiger

As transformers are equivariant to the permutation of input tokens, encoding the positional information of tokens is necessary for many tasks.

Novel View Synthesis

PanopticNeRF-360: Panoramic 3D-to-2D Label Transfer in Urban Scenes

1 code implementation19 Sep 2023 Xiao Fu, Shangzhan Zhang, Tianrun Chen, Yichong Lu, Xiaowei Zhou, Andreas Geiger, Yiyi Liao

Moreover, PanopticNeRF-360 enables omnidirectional rendering of high-fidelity, multi-view and spatiotemporally consistent appearance, semantic and instance labels.

Self-Driving Cars

On Offline Evaluation of 3D Object Detection for Autonomous Driving

no code implementations24 Aug 2023 Tim Schreier, Katrin Renz, Andreas Geiger, Kashyap Chitta

Prior work in 3D object detection evaluates models using offline metrics like average precision since closed-loop online evaluation on the downstream driving task is costly.

3D Object Detection Autonomous Driving +2

End-to-end Autonomous Driving: Challenges and Frontiers

1 code implementation29 Jun 2023 Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, Hongyang Li

The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as detection and motion prediction.

Autonomous Driving motion prediction

Parting with Misconceptions about Learning-based Vehicle Motion Planning

2 code implementations13 Jun 2023 Daniel Dauner, Marcel Hallgarten, Andreas Geiger, Kashyap Chitta

The release of nuPlan marks a new era in vehicle motion planning research, offering the first large-scale real-world dataset and evaluation schemes requiring both precise short-term planning and long-horizon ego-forecasting.

Misconceptions Motion Planning

Towards Scalable Multi-View Reconstruction of Geometry and Materials

no code implementations6 Jun 2023 Carolin Schmitt, Božidar Antić, Andrei Neculai, Joo Ho Lee, Andreas Geiger

In this paper, we propose a novel method for joint recovery of camera pose, object geometry and spatially-varying Bidirectional Reflectance Distribution Function (svBRDF) of 3D scenes that exceed object-scale and hence cannot be captured with stationary light stages.

Distributed Optimization

AG3D: Learning to Generate 3D Avatars from 2D Image Collections

no code implementations ICCV 2023 Zijian Dong, Xu Chen, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger

The key to progress is hence to learn generative models of 3D avatars from abundant unstructured 2D image collections.

MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes

no code implementations23 Feb 2023 Christian Reiser, Richard Szeliski, Dor Verbin, Pratul P. Srinivasan, Ben Mildenhall, Andreas Geiger, Jonathan T. Barron, Peter Hedman

We design a lossless procedure for baking the parameterization used during training into a model that achieves real-time rendering while still preserving the photorealistic view synthesis quality of a volumetric radiance field.

NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM

no code implementations7 Feb 2023 Zihan Zhu, Songyou Peng, Viktor Larsson, Zhaopeng Cui, Martin R. Oswald, Andreas Geiger, Marc Pollefeys

Neural implicit representations have recently become popular in simultaneous localization and mapping (SLAM), especially in dense visual SLAM.

3D Scene Reconstruction Novel View Synthesis +2

Factor Fields: A Unified Framework for Neural Fields and Beyond

1 code implementation2 Feb 2023 Anpei Chen, Zexiang Xu, Xinyue Wei, Siyu Tang, Hao Su, Andreas Geiger

Our experiments show that DiF leads to improvements in approximation quality, compactness, and training time when compared to previous fast reconstruction methods.

regression

StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis

1 code implementation23 Jan 2023 Axel Sauer, Tero Karras, Samuli Laine, Andreas Geiger, Timo Aila

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models.

Text-to-Image Generation

GOOD: Exploring Geometric Cues for Detecting Objects in an Open World

1 code implementation22 Dec 2022 Haiwen Huang, Andreas Geiger, Dan Zhang

We address the task of open-world class-agnostic object detection, i. e., detecting every object in an image by learning from a limited number of base object classes.

Class-agnostic Object Detection Object +2

Fast-SNARF: A Fast Deformer for Articulated Neural Fields

1 code implementation28 Nov 2022 Xu Chen, Tianjian Jiang, Jie Song, Max Rietmann, Andreas Geiger, Michael J. Black, Otmar Hilliges

A key challenge in making such methods applicable to articulated objects, such as the human body, is to model the deformation of 3D locations between the rest pose (a canonical space) and the deformed space.

3D Reconstruction Computational Efficiency +1

Unifying Flow, Stereo and Depth Estimation

1 code implementation10 Nov 2022 Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Fisher Yu, DaCheng Tao, Andreas Geiger

We present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images.

Optical Flow Estimation Stereo Depth Estimation +1

Deep Generative Models on 3D Representations: A Survey

1 code implementation27 Oct 2022 Zifan Shi, Sida Peng, Yinghao Xu, Andreas Geiger, Yiyi Liao, Yujun Shen

In this survey, we thoroughly review the ongoing developments of 3D generative models, including methods that employ 2D and 3D supervision.

3D-Aware Image Synthesis 3D Shape Generation

ARAH: Animatable Volume Rendering of Articulated Human SDFs

no code implementations18 Oct 2022 Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang

We demonstrate that our proposed pipeline can generate clothed avatars with high-quality pose-dependent geometry and appearance from a sparse set of multi-view RGB videos.

VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids

1 code implementation15 Jun 2022 Katja Schwarz, Axel Sauer, Michael Niemeyer, Yiyi Liao, Andreas Geiger

State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields.

3D-Aware Image Synthesis Neural Rendering +1

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

1 code implementation1 Jun 2022 Zehao Yu, Songyou Peng, Michael Niemeyer, Torsten Sattler, Andreas Geiger

Motivated by recent advances in the area of monocular geometry prediction, we systematically explore the utility these cues provide for improving neural implicit surface reconstruction.

3D Reconstruction Multi-View 3D Reconstruction +1

Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentation

1 code implementation29 Mar 2022 Xiao Fu, Shangzhan Zhang, Tianrun Chen, Yichong Lu, Lanyun Zhu, Xiaowei Zhou, Andreas Geiger, Yiyi Liao

In this work, we present a novel 3D-to-2D label transfer method, Panoptic NeRF, which aims for obtaining per-pixel 2D semantic and instance labels from easy-to-obtain coarse 3D bounding primitives.

Instance Segmentation Scene Segmentation

TensoRF: Tensorial Radiance Fields

2 code implementations17 Mar 2022 Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, Hao Su

We demonstrate that applying traditional CP decomposition -- that factorizes tensors into rank-one components with compact vectors -- in our framework leads to improvements over vanilla NeRF.

Low-Dose X-Ray Ct Reconstruction Novel View Synthesis

StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

2 code implementations1 Feb 2022 Axel Sauer, Katja Schwarz, Andreas Geiger

StyleGAN in particular sets new standards for generative modeling regarding image quality and controllability.

 Ranked #1 on Image Generation on CIFAR-10 (NFE metric)

Image Generation

gDNA: Towards Generative Detailed Neural Avatars

no code implementations CVPR 2022 Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael J. Black, Andreas Geiger, Otmar Hilliges

Furthermore, we show that our method can be used on the task of fitting human models to raw scans, outperforming the previous state-of-the-art.

RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs

no code implementations CVPR 2022 Michael Niemeyer, Jonathan T. Barron, Ben Mildenhall, Mehdi S. M. Sajjadi, Andreas Geiger, Noha Radwan

We observe that the majority of artifacts in sparse input scenarios are caused by errors in the estimated scene geometry, and by divergent behavior at the start of training.

Novel View Synthesis

On the Frequency Bias of Generative Models

1 code implementation NeurIPS 2021 Katja Schwarz, Yiyi Liao, Andreas Geiger

2) Checkerboard artifacts introduced by upsampling cannot explain the spectral discrepancies alone as the generator is able to compensate for these artifacts.

Attribute

ATISS: Autoregressive Transformers for Indoor Scene Synthesis

1 code implementation NeurIPS 2021 Despoina Paschalidou, Amlan Kar, Maria Shugrina, Karsten Kreis, Andreas Geiger, Sanja Fidler

The ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation.

2D Semantic Segmentation task 1 (8 classes) 3D Semantic Scene Completion +1

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

2 code implementations28 Sep 2021 Yiyi Liao, Jun Xie, Andreas Geiger

For the last few decades, several major subfields of artificial intelligence including computer vision, graphics, and robotics have progressed largely independently from each other.

Novel View Synthesis Scene Understanding +2

NEAT: Neural Attention Fields for End-to-End Autonomous Driving

1 code implementation ICCV 2021 Kashyap Chitta, Aditya Prakash, Andreas Geiger

Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial prerequisite for autonomous driving.

Autonomous Driving CARLA longest6 +2

Learning Cascaded Detection Tasks with Weakly-Supervised Domain Adaptation

no code implementations9 Jul 2021 Niklas Hanselmann, Nick Schneider, Benedikt Ortelt, Andreas Geiger

In order to handle the challenges of autonomous driving, deep learning has proven to be crucial in tackling increasingly complex tasks, such as 3D detection or instance segmentation.

Autonomous Driving Domain Adaptation +2

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images

1 code implementation NeurIPS 2021 Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang

In contrast, we propose an approach that can quickly generate realistic clothed human avatars, represented as controllable neural SDFs, given only monocular depth images.

Meta-Learning

Shape As Points: A Differentiable Poisson Solver

1 code implementation NeurIPS 2021 Songyou Peng, Chiyu "Max" Jiang, Yiyi Liao, Michael Niemeyer, Marc Pollefeys, Andreas Geiger

However, the implicit nature of neural implicit representations results in slow inference time and requires careful initialization.

3D Reconstruction Surface Reconstruction

Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration

no code implementations CVPR 2021 Shaofei Wang, Andreas Geiger, Siyu Tang

We combine PTF with multi-class occupancy networks, obtaining a novel learning-based framework that learns to simultaneously predict shape and per-point correspondences between the posed space and the canonical space for clothed human.

Surface Reconstruction Translation

SMD-Nets: Stereo Mixture Density Networks

2 code implementations CVPR 2021 Fabio Tosi, Yiyi Liao, Carolin Schmitt, Andreas Geiger

Despite stereo matching accuracy has greatly improved by deep learning in the last few years, recovering sharp boundaries and high-resolution outputs efficiently remains challenging.

Disparity Estimation Stereo Matching

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes

1 code implementation ICCV 2021 Xu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges, Andreas Geiger

However, this is problematic since the backward warp field is pose dependent and thus requires large amounts of data to learn.

CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields

no code implementations31 Mar 2021 Michael Niemeyer, Andreas Geiger

At test time, our model generates images with explicit control over the camera as well as the shape and appearance of the scene.

3D-Aware Image Synthesis

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

4 code implementations ICCV 2021 Christian Reiser, Songyou Peng, Yiyi Liao, Andreas Geiger

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images.

Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networks

1 code implementation CVPR 2021 Despoina Paschalidou, Angelos Katharopoulos, Andreas Geiger, Sanja Fidler

The INN allows us to compute the inverse mapping of the homeomorphism, which in turn, enables the efficient computation of both the implicit surface function of a primitive and its mesh, without any additional post-processing.

Counterfactual Generative Networks

1 code implementation ICLR 2021 Axel Sauer, Andreas Geiger

Prior works on image classification show that instead of learning a connection to object shape, deep classifiers tend to exploit spurious correlations with low-level texture or the background for solving the classification task.

Classification counterfactual +4

GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields

1 code implementation CVPR 2021 Michael Niemeyer, Andreas Geiger

While several recent works investigate how to disentangle underlying factors of variation in the data, most of them operate in 2D and hence ignore that our world is three-dimensional.

Image Generation Neural Rendering

Category Level Object Pose Estimation via Neural Analysis-by-Synthesis

no code implementations ECCV 2020 Xu Chen, Zijian Dong, Jie Song, Andreas Geiger, Otmar Hilliges

Many object pose estimation algorithms rely on the analysis-by-synthesis framework which requires explicit representations of individual object instances.

Image Generation Object +1

GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis

1 code implementation NeurIPS 2020 Katja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas Geiger

In contrast to voxel-based representations, radiance fields are not confined to a coarse discretization of the 3D space, yet allow for disentangling camera and scene properties while degrading gracefully in the presence of reconstruction ambiguity.

3D-Aware Image Synthesis Novel View Synthesis +1

Intrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image Decomposition

no code implementations29 Jun 2020 Hassan Abu Alhaija, Siva Karthik Mustikovela, Justus Thies, Varun Jampani, Matthias Nießner, Andreas Geiger, Carsten Rother

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process.

Image-to-Image Translation Intrinsic Image Decomposition +1

Benchmarking Unsupervised Object Representations for Video Sequences

1 code implementation12 Jun 2020 Marissa A. Weis, Kashyap Chitta, Yash Sharma, Wieland Brendel, Matthias Bethge, Andreas Geiger, Alexander S. Ecker

Perceiving the world in terms of objects and tracking them through time is a crucial prerequisite for reasoning and scene understanding.

Benchmarking Clustering +5

Learning Neural Light Transport

no code implementations5 Jun 2020 Paul Sanzenbacher, Lars Mescheder, Andreas Geiger

In recent years, deep generative models have gained significance due to their ability to synthesize natural-looking images with applications ranging from virtual reality to data augmentation for training computer vision models.

Data Augmentation Image Denoising

Label Efficient Visual Abstractions for Autonomous Driving

3 code implementations20 May 2020 Aseem Behl, Kashyap Chitta, Aditya Prakash, Eshed Ohn-Bar, Andreas Geiger

Beyond label efficiency, we find several additional training benefits when leveraging visual abstractions, such as a significant reduction in the variance of the learned policy when compared to state-of-the-art end-to-end driving models.

Autonomous Driving Segmentation +1

Learning Unsupervised Hierarchical Part Decomposition of 3D Objects from a Single RGB Image

1 code implementation CVPR 2020 Despoina Paschalidou, Luc van Gool, Andreas Geiger

Humans perceive the 3D world as a set of distinct objects that are characterized by various low-level (geometry, reflectance) and high-level (connectivity, adjacency, symmetry) properties.

3D Reconstruction

Learning Implicit Surface Light Fields

3 code implementations27 Mar 2020 Michael Oechsle, Michael Niemeyer, Lars Mescheder, Thilo Strauss, Andreas Geiger

In this work, we propose a novel implicit representation for capturing the visual appearance of an object in terms of its surface light field.

3D Reconstruction Image Generation +1

Convolutional Occupancy Networks

6 code implementations ECCV 2020 Songyou Peng, Michael Niemeyer, Lars Mescheder, Marc Pollefeys, Andreas Geiger

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction.

3D Reconstruction

Self-Supervised Linear Motion Deblurring

1 code implementation10 Feb 2020 Peidong Liu, Joel Janai, Marc Pollefeys, Torsten Sattler, Andreas Geiger

Motion blurry images challenge many computer vision algorithms, e. g, feature detection, motion estimation, or object recognition.

Deblurring Image Deblurring +4

Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesis

1 code implementation CVPR 2020 Yiyi Liao, Katja Schwarz, Lars Mescheder, Andreas Geiger

We define the new task of 3D controllable image synthesis and propose an approach for solving it by reasoning both in 3D space and in the 2D image domain.

Image Generation Object

Attacking Optical Flow

1 code implementation ICCV 2019 Anurag Ranjan, Joel Janai, Andreas Geiger, Michael J. Black

In this paper, we extend adversarial patch attacks to optical flow networks and show that such attacks can compromise their performance.

Optical Flow Estimation Self-Driving Cars

Texture Fields: Learning Texture Representations in Function Space

no code implementations ICCV 2019 Michael Oechsle, Lars Mescheder, Michael Niemeyer, Thilo Strauss, Andreas Geiger

A major reason for these limitations is that common representations of texture are inefficient or hard to interface for modern deep learning techniques.

Robust Dense Mapping for Large-Scale Dynamic Environments

no code implementations7 May 2019 Ioan Andrei Bârsan, Peidong Liu, Marc Pollefeys, Andreas Geiger

We use both instance-aware semantic segmentation and sparse scene flow to classify objects as either background, moving, or potentially moving, thereby ensuring that the system is able to model objects with the potential to transition from static to dynamic, such as parked cars.

Semantic Segmentation Visual Odometry

Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboids

1 code implementation CVPR 2019 Despoina Paschalidou, Ali Osman Ulusoy, Andreas Geiger

Abstracting complex 3D shapes with parsimonious part-based representations has been a long standing goal in computer vision.

RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials

1 code implementation CVPR 2018 Despoina Paschalidou, Ali Osman Ulusoy, Carolin Schmitt, Luc van Gool, Andreas Geiger

RayNet integrates a CNN that learns view-invariant feature representations with an MRF that explicitly encodes the physics of perspective projection and occlusion.

3D Reconstruction

Taking a Deeper Look at the Inverse Compositional Algorithm

1 code implementation CVPR 2019 Zhaoyang Lv, Frank Dellaert, James M. Rehg, Andreas Geiger

In this paper, we provide a modern synthesis of the classic inverse compositional algorithm for dense image alignment.

Motion Estimation regression

Geometric Image Synthesis

no code implementations12 Sep 2018 Hassan Abu Alhaija, Siva Karthik Mustikovela, Andreas Geiger, Carsten Rother

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics.

Image Generation Instance Segmentation +1

Learning Priors for Semantic 3D Reconstruction

no code implementations ECCV 2018 Ian Cherabier, Johannes L. Schonberger, Martin R. Oswald, Marc Pollefeys, Andreas Geiger

In contrast to existing variational methods for semantic 3D reconstruction, our model is end-to-end trainable and captures more complex dependencies between the semantic labels and the 3D geometry.

3D Reconstruction

SphereNet: Learning Spherical Representations for Detection and Classification in Omnidirectional Images

no code implementations ECCV 2018 Benjamin Coors, Alexandru Paul Condurache, Andreas Geiger

Omnidirectional cameras offer great benefits over classical cameras wherever a wide field of view is essential, such as in virtual reality applications or in autonomous robots.

General Classification Image Classification +2

Conditional Affordance Learning for Driving in Urban Environments

1 code implementation18 Jun 2018 Axel Sauer, Nikolay Savinov, Andreas Geiger

Most existing approaches to autonomous driving fall into one of two categories: modular pipelines, that build an extensive model of the environment, and imitation learning approaches, that map images directly to control outputs.

Autonomous Driving Autonomous Navigation +2

Learning 3D Shape Completion From Laser Scan Data With Weak Supervision

1 code implementation CVPR 2018 David Stutz, Andreas Geiger

Learning-based approaches, in contrast, avoid the expensive optimization step and instead directly predict the complete shape from the incomplete observations using deep neural networks.

Weakly-supervised Learning

Deep Marching Cubes: Learning Explicit Surface Representations

1 code implementation CVPR 2018 Yiyi Liao, Simon Donné, Andreas Geiger

Existing learning based solutions to 3D surface prediction cannot be trained end-to-end as they operate on intermediate representations (e. g., TSDF) from which 3D surface meshes must be extracted in a post-processing step (e. g., via the marching cubes algorithm).

Learning 3D Shape Completion under Weak Supervision

4 code implementations18 May 2018 David Stutz, Andreas Geiger

We address the problem of 3D shape completion from sparse and noisy point clouds, a fundamental problem in computer vision and robotics.

Weakly-supervised Learning

Which Training Methods for GANs do actually Converge?

9 code implementations ICML 2018 Lars Mescheder, Andreas Geiger, Sebastian Nowozin

In this paper, we show that the requirement of absolute continuity is necessary: we describe a simple yet prototypical counterexample showing that in the more realistic case of distributions that are not absolutely continuous, unregularized GAN training is not always convergent.

On the Integration of Optical Flow and Action Recognition

no code implementations22 Dec 2017 Laura Sevilla-Lara, Yiyi Liao, Fatma Guney, Varun Jampani, Andreas Geiger, Michael J. Black

Here we take a deeper look at the combination of flow and action recognition, and investigate why optical flow is helpful, what makes a flow method good for action recognition, and how we can make it better.

Action Recognition Optical Flow Estimation +1

Semantic Visual Localization

no code implementations CVPR 2018 Johannes L. Schönberger, Marc Pollefeys, Andreas Geiger, Torsten Sattler

Robust visual localization under a wide range of viewing conditions is a fundamental problem in computer vision.

Visual Localization

Sparsity Invariant CNNs

1 code implementation22 Aug 2017 Jonas Uhrig, Nick Schneider, Lukas Schneider, Uwe Franke, Thomas Brox, Andreas Geiger

In this paper, we consider convolutional neural networks operating on sparse inputs with an application to depth upsampling from sparse laser scan data.

Depth Completion Depth Estimation +1

Augmented Reality Meets Computer Vision : Efficient Data Generation for Urban Driving Scenes

no code implementations4 Aug 2017 Hassan Abu Alhaija, Siva Karthik Mustikovela, Lars Mescheder, Andreas Geiger, Carsten Rother

Further, we demonstrate the utility of our approach on training standard deep models for semantic instance segmentation and object detection of cars in outdoor driving scenes.

Instance Segmentation Object +3

Semantic Multi-View Stereo: Jointly Estimating Objects and Voxels

no code implementations CVPR 2017 Ali Osman Ulusoy, Michael J. Black, Andreas Geiger

Due to its probabilistic nature, the approach is able to cope with the approximate geometry of the 3D models as well as input shapes that are not present in the scene.

3D Reconstruction

The Numerics of GANs

4 code implementations NeurIPS 2017 Lars Mescheder, Sebastian Nowozin, Andreas Geiger

In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs).

Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art

no code implementations18 Apr 2017 Joel Janai, Fatma Güney, Aseem Behl, Andreas Geiger

Towards this goal, we analyze the performance of the state of the art on several challenging benchmarking datasets, including KITTI, MOT, and Cityscapes.

Autonomous Driving Benchmarking +2

OctNetFusion: Learning Depth Fusion from Data

1 code implementation4 Apr 2017 Gernot Riegler, Ali Osman Ulusoy, Horst Bischof, Andreas Geiger

In this paper, we present a learning based approach to depth fusion, i. e., dense 3D reconstruction from multiple depth images.

3D Reconstruction

Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks

1 code implementation ICML 2017 Lars Mescheder, Sebastian Nowozin, Andreas Geiger

We show that in the nonparametric limit our method yields an exact maximum-likelihood assignment for the parameters of the generative model, as well as the exact posterior distribution over the latent variables given an observation.

Probabilistic Duality for Parallel Gibbs Sampling without Graph Coloring

no code implementations21 Nov 2016 Lars Mescheder, Sebastian Nowozin, Andreas Geiger

We present a new notion of probabilistic duality for random variables involving mixture distributions.

Blocking

Exploiting Object Similarity in 3D Reconstruction

no code implementations ICCV 2015 Chen Zhou, Fatma Guney, Yizhou Wang, Andreas Geiger

Despite recent progress, reconstructing outdoor scenes in 3D from movable platforms remains a highly difficult endeavour.

3D Reconstruction Object

Object Scene Flow for Autonomous Vehicles

no code implementations CVPR 2015 Moritz Menze, Andreas Geiger

We demonstrate the performance of our model on existing benchmarks as well as a novel realistic dataset with scene flow ground truth.

Autonomous Driving Object +2

Displets: Resolving Stereo Ambiguities Using Object Knowledge

no code implementations CVPR 2015 Fatma Guney, Andreas Geiger

Stereo techniques have witnessed tremendous progress over the last decades, yet some aspects of the problem still remain challenging today.

Object Semantic Segmentation

Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization

no code implementations CVPR 2013 Marcus A. Brubaker, Andreas Geiger, Raquel Urtasun

In this paper we propose an affordable solution to selflocalization, which utilizes visual odometry and road maps as the only inputs.

Visual Odometry

Joint 3D Estimation of Objects and Scene Layout

no code implementations NeurIPS 2011 Andreas Geiger, Christian Wojek, Raquel Urtasun

We propose a novel generative model that is able to reason jointly about the 3D scene layout as well as the 3D location and orientation of objects in the scene.

Cannot find the paper you are looking for? You can Submit a new open access paper.