Search Results for author: Ameesh Makadia

Found 28 papers, 14 papers with code

Single Mesh Diffusion Models with Field Latents for Texture Generation

no code implementations14 Dec 2023 Thomas W. Mitchel, Carlos Esteves, Ameesh Makadia

We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes, with the goal of synthesizing high-quality textures.

Texture Synthesis

Learning to Transform for Generalizable Instance-wise Invariance

1 code implementation ICCV 2023 Utkarsh Singhal, Carlos Esteves, Ameesh Makadia, Stella X. Yu

However, too much or too little invariance can hurt, and the correct amount is unknown a priori and dependent on the instance.

Data Augmentation

Scaling Spherical CNNs

1 code implementation8 Jun 2023 Carlos Esteves, Jean-Jacques Slotine, Ameesh Makadia

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation.

Weather Forecasting

LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs

no code implementations ICCV 2023 Zezhou Cheng, Carlos Esteves, Varun Jampani, Abhishek Kar, Subhransu Maji, Ameesh Makadia

Consequently, there is growing interest in extending NeRF models to jointly optimize camera poses and scene representation, which offers an alternative to off-the-shelf SfM pipelines which have well-understood failure modes.

Pose Estimation

ASIC: Aligning Sparse in-the-wild Image Collections

no code implementations ICCV 2023 Kamal Gupta, Varun Jampani, Carlos Esteves, Abhinav Shrivastava, Ameesh Makadia, Noah Snavely, Abhishek Kar

We present a self-supervised technique that directly optimizes on a sparse collection of images of a particular object/object category to obtain consistent dense correspondences across the collection.

Object

Stable Object Reorientation using Contact Plane Registration

no code implementations18 Aug 2022 Richard Li, Carlos Esteves, Ameesh Makadia, Pulkit Agrawal

We present a system for accurately predicting stable orientations for diverse rigid objects.

Object

Generalizable Patch-Based Neural Rendering

no code implementations21 Jul 2022 Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia

Neural rendering has received tremendous attention since the advent of Neural Radiance Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably.

Neural Rendering Novel View Synthesis

Light Field Neural Rendering

1 code implementation CVPR 2022 Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene.

Neural Rendering Novel View Synthesis

Generalized Fourier Features for Coordinate-Based Learning of Functions on Manifolds

no code implementations29 Sep 2021 Carlos Esteves, Tianjian Lu, Mohammed Suhail, Yi-fan Chen‎, Ameesh Makadia

In this work, we generalize positional encoding with Fourier features to non-Euclidean manifolds.

Approximate Bijective Correspondence for isolating factors of variation

1 code implementation29 Sep 2021 Kieran A Murphy, Varun Jampani, Srikumar Ramalingam, Ameesh Makadia

We propose a novel algorithm that relies on a weak form of supervision where the data is partitioned into sets according to certain \textit{inactive} factors of variation.

Contrastive Learning Data Augmentation +1

Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifold

2 code implementations10 Jun 2021 Kieran Murphy, Carlos Esteves, Varun Jampani, Srikumar Ramalingam, Ameesh Makadia

Single image pose estimation is a fundamental problem in many vision and robotics tasks, and existing deep learning approaches suffer by not completely modeling and handling: i) uncertainty about the predictions, and ii) symmetric objects with multiple (sometimes infinite) correct poses.

3D Pose Estimation 3D Rotation Estimation

Wide-Baseline Relative Camera Pose Estimation with Directional Learning

1 code implementation CVPR 2021 Kefan Chen, Noah Snavely, Ameesh Makadia

Modern deep learning techniques that regress the relative camera pose between two images have difficulty dealing with challenging scenarios, such as large camera motions resulting in occlusions and significant changes in perspective that leave little overlap between images.

Pose Estimation regression

De-rendering the World's Revolutionary Artefacts

1 code implementation CVPR 2021 Shangzhe Wu, Ameesh Makadia, Jiajun Wu, Noah Snavely, Richard Tucker, Angjoo Kanazawa

Recent works have shown exciting results in unsupervised image de-rendering -- learning to decompose 3D shape, appearance, and lighting from single-image collections without explicit supervision.

Learning ABCs: Approximate Bijective Correspondence for isolating factors of variation with weak supervision

1 code implementation CVPR 2022 Kieran A. Murphy, Varun Jampani, Srikumar Ramalingam, Ameesh Makadia

We propose a novel algorithm that utilizes a weak form of supervision where the data is partitioned into sets according to certain inactive (common) factors of variation which are invariant across elements of each set.

Data Augmentation Pose Transfer

Leveraging affinity cycle consistency to isolate factors of variation in learned representations

no code implementations1 Jan 2021 Kieran A Murphy, Varun Jampani, Srikumar Ramalingam, Ameesh Makadia

In this work, we operate in the setting where limited information is known about the data in the form of groupings, or set membership, and the task is to learn representations which isolate the factors of variation that are common across the groupings.

Pose Transfer Representation Learning

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

1 code implementation ICCV 2021 Andrew Liu, Richard Tucker, Varun Jampani, Ameesh Makadia, Noah Snavely, Angjoo Kanazawa

We introduce the problem of perpetual view generation - long-range generation of novel views corresponding to an arbitrarily long camera trajectory given a single image.

Image Generation Perpetual View Generation +1

An Analysis of SVD for Deep Rotation Estimation

2 code implementations NeurIPS 2020 Jake Levinson, Carlos Esteves, Kefan Chen, Noah Snavely, Angjoo Kanazawa, Afshin Rostamizadeh, Ameesh Makadia

Symmetric orthogonalization via SVD, and closely related procedures, are well-known techniques for projecting matrices onto $O(n)$ or $SO(n)$.

3D Pose Estimation 3D Rotation Estimation

Spin-Weighted Spherical CNNs

2 code implementations NeurIPS 2020 Carlos Esteves, Ameesh Makadia, Kostas Daniilidis

In this paper, we present a new type of spherical CNN that allows anisotropic filters in an efficient way, without ever leaving the spherical domain.

Semantic Segmentation

Time Dependence in Non-Autonomous Neural ODEs

no code implementations ICLR Workshop DeepDiffEq 2019 Jared Quincy Davis, Krzysztof Choromanski, Jake Varley, Honglak Lee, Jean-Jacques Slotine, Valerii Likhosterov, Adrian Weller, Ameesh Makadia, Vikas Sindhwani

Neural Ordinary Differential Equations (ODEs) are elegant reinterpretations of deep networks where continuous time can replace the discrete notion of depth, ODE solvers perform forward propagation, and the adjoint method enables efficient, constant memory backpropagation.

Image Classification Video Prediction

Local Implicit Grid Representations for 3D Scenes

1 code implementation19 Mar 2020 Chiyu Max Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang, Matthias Nießner, Thomas Funkhouser

Then, we use the decoder as a component in a shape optimization that solves for a set of latent codes on a regular grid of overlapping crops such that an interpolation of the decoded local shapes matches a partial or noisy observation.

3D Shape Representation Surface Reconstruction

Latent feature disentanglement for 3D meshes

no code implementations7 Jun 2019 Jake Levinson, Avneesh Sud, Ameesh Makadia

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR.

Disentanglement

Cross-Domain 3D Equivariant Image Embeddings

1 code implementation6 Dec 2018 Carlos Esteves, Avneesh Sud, Zhengyi Luo, Kostas Daniilidis, Ameesh Makadia

This embedding encodes images with 3D shape properties and is equivariant to 3D rotations of the observed object.

3D Shape Classification Novel View Synthesis +2

Labeling Panoramas with Spherical Hourglass Networks

no code implementations6 Sep 2018 Carlos Esteves, Kostas Daniilidis, Ameesh Makadia

With the recent proliferation of consumer-grade 360{\deg} cameras, it is worth revisiting visual perception challenges with spherical cameras given the potential benefit of their global field of view.

Semantic Segmentation

Geometry of 3D Environments and Sum of Squares Polynomials

no code implementations22 Nov 2016 Amir Ali Ahmadi, Georgina Hall, Ameesh Makadia, Vikas Sindhwani

Motivated by applications in robotics and computer vision, we study problems related to spatial reasoning of a 3D environment using sublevel sets of polynomials.

Cannot find the paper you are looking for? You can Submit a new open access paper.