GVP: Generative Volumetric Primitives
AI-generated Key Points
⚠The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.
- Advances in 3D-aware generative models have advanced image synthesis with explicit camera control.
- Existing approaches struggle to achieve high-resolution image synthesis without compromising multiview consistency.
- The paper introduces Generative Volumetric Primitives (GVP), the first pure 3D generative model capable of real-time rendering of 512-resolution images.
- GVP achieves this by jointly modeling volumetric primitives and their spatial information using a 2D convolutional network.
- GVP efficiently generates both primitives and their corresponding sparsity in the 3D volume.
- The authors employ knowledge distillation to effectively train GVP, enabling it to learn from multiple datasets while maintaining superior efficiency and 3D consistency compared to state-of-the-art methods.
- GVP represents a significant advancement in image synthesis, providing a pure 3D generative model for high-resolution images with explicit camera control and multiview consistency.
Authors: Mallikarjun B R, Xingang Pan, Mohamed Elgharib, Christian Theobalt
Abstract: Advances in 3D-aware generative models have pushed the boundary of image synthesis with explicit camera control. To achieve high-resolution image synthesis, several attempts have been made to design efficient generators, such as hybrid architectures with both 3D and 2D components. However, such a design compromises multiview consistency, and the design of a pure 3D generator with high resolution is still an open problem. In this work, we present Generative Volumetric Primitives (GVP), the first pure 3D generative model that can sample and render 512-resolution images in real-time. GVP jointly models a number of volumetric primitives and their spatial information, both of which can be efficiently generated via a 2D convolutional network. The mixture of these primitives naturally captures the sparsity and correspondence in the 3D volume. The training of such a generator with a high degree of freedom is made possible through a knowledge distillation technique. Experiments on several datasets demonstrate superior efficiency and 3D consistency of GVP over the state-of-the-art.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
⚠The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.