About

Given a representation of a 3D scene of some kind (point cloud, mesh, voxels, etc.), the task is to create an algorithm that can produce photorealistic renderings of this scene from an arbitrary viewpoint. Sometimes, the task is accompanied by image/scene appearance manipulation.

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis

ECCV 2020 facebookresearch/pytorch3d

Our algorithm represents a scene using a fully-connected (non-convolutional) deep network, whose input is a single continuous 5D coordinate (spatial location $(x, y, z)$ and viewing direction $(\theta, \phi)$) and whose output is the volume density and view-dependent emitted radiance at that spatial location.

NEURAL RENDERING NOVEL VIEW SYNTHESIS

Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEs

21 Jan 2019deepmind/spriteworld

We present a simple neural rendering architecture that helps variational autoencoders (VAEs) learn disentangled representations.

NEURAL RENDERING

PlenOctrees for Real-time Rendering of Neural Radiance Fields

25 Mar 2021sxyu/volrend

We introduce a method to render Neural Radiance Fields (NeRFs) in real time using PlenOctrees, an octree-based 3D representation which supports view-dependent effects.

NEURAL RENDERING NOVEL VIEW SYNTHESIS

Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars

ECCV 2020 saic-violet/bilayer-model

The texture image is generated offline, warped and added to the coarse image to ensure a high effective resolution of synthesized head views.

NEURAL RENDERING TALKING HEAD GENERATION

Deferred Neural Rendering: Image Synthesis using Neural Textures

28 Apr 2019SSRSGJYD/NeuralTexture

Similar to traditional textures, neural textures are stored as maps on top of 3D mesh proxies; however, the high-dimensional feature maps contain significantly more information, which can be interpreted by our new deferred neural rendering pipeline.

IMAGE GENERATION NEURAL RENDERING NOVEL VIEW SYNTHESIS

A Neural Rendering Framework for Free-Viewpoint Relighting

CVPR 2020 LansburyCH/relightable-nr

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs.

NEURAL RENDERING NOVEL VIEW SYNTHESIS

CONFIG: Controllable Neural Face Image Generation

ECCV 2020 microsoft/ConfigNet

Our ability to sample realistic natural images, particularly faces, has advanced by leaps and bounds in recent years, yet our ability to exert fine-tuned control over the generative process has lagged behind.

FACE MODEL IMAGE GENERATION NEURAL RENDERING

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

2 Dec 2020lucidrains/pi-GAN-pytorch

We have witnessed rapid progress on 3D-aware image synthesis, leveraging recent advances in generative visual models and neural rendering.

IMAGE GENERATION NEURAL RENDERING SCENE GENERATION

Equivariant Neural Rendering

ICML 2020 apple/ml-equivariant-neural-rendering

We propose a framework for learning neural scene representations directly from images, without 3D supervision.

NEURAL RENDERING