ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models

1 code implementation • 4 Mar 2024 • Lukas Höllein, Aljaž Božič, Norman Müller, David Novotny, Hung-Yu Tseng, Christian Richardt, Michael Zollhöfer, Matthias Nießner

In this paper, we present a method that leverages pretrained text-to-image models as a prior, and learn to generate multi-view images in a single denoising process from real-world data.

Denoising Image Generation +1

ControlRoom3D: Room Generation using Semantic Proxy Rooms

no code implementations • 8 Dec 2023 • Jonas Schult, Sam Tsai, Lukas Höllein, Bichen Wu, Jialiang Wang, Chih-Yao Ma, Kunpeng Li, Xiaofang Wang, Felix Wimbauer, Zijian He, Peizhao Zhang, Bastian Leibe, Peter Vajda, Ji Hou

Central to our approach is a user-defined 3D semantic proxy room that outlines a rough room layout based on semantic bounding boxes and a textual description of the overall room style.

Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models

1 code implementation • ICCV 2023 • Lukas Höllein, Ang Cao, Andrew Owens, Justin Johnson, Matthias Nießner

We present Text2Room, a method for generating room-scale textured 3D meshes from a given text prompt as input.

Text to 3D

StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions

1 code implementation • CVPR 2022 • Lukas Höllein, Justin Johnson, Matthias Nießner

Style transfer typically operates on 2D images, making stylization of a mesh challenging.

Style Transfer