Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D

no code implementations • 2 Dec 2023 • Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy Mitra

Our key insight is to lift diffusion activations for an object to 3D using a proxy depth, 3D-transform the depth and associated activations, and project them back to image space.

3D Object Retrieval Depth Estimation +2