Layout-guided Indoor Panorama Inpainting with Plane-aware Normalization
AI-generated Key Points
- Gao et al. present an end-to-end deep learning framework for indoor panoramic image inpainting.
- Previous inpainting methods have difficulty handling complex structure and texture content in indoor scenes.
- The authors propose to exploit both the global and local context of indoor panorama during the inpainting process.
- They use low-level layout edges as a prior to guide the inpainting model for recovering the global indoor structure.
- A plane-aware normalization module is employed to embed plane-wise style features derived from the layout into the generator, encouraging local texture restoration from adjacent room structures (i.e., ceiling, floor, and walls).
- This method outperforms current state-of-the-art methods on a public panoramic dataset in both qualitative and quantitative evaluations.
- The authors compare their approach with other structure-aware methods such as EdgeConnect and multi-task learning frameworks like LISK, noting that these methods still fail to model long-range structure correspondence such as layout in indoor scenes.
- Limitations of their approach include residuals of shading effect caused by removed furniture that can be hard to segment and model accurately; however, their model still produces more realistic results than PanoDR.
- This work presents a promising approach for improving indoor panorama image inpainting quality by incorporating structure knowledge through exploiting both global and local context during the inpainting process.
- Future work includes adopting a more reasonable segmentation mask of indoor scenes' shading areas to improve results in those shaded scenes.
Authors: Chao-Chen Gao, Cheng-Hsiu Chen, Jheng-Wei Su, Hung-Kuo Chu
Abstract: We present an end-to-end deep learning framework for indoor panoramic image inpainting. Although previous inpainting methods have shown impressive performance on natural perspective images, most fail to handle panoramic images, particularly indoor scenes, which usually contain complex structure and texture content. To achieve better inpainting quality, we propose to exploit both the global and local context of indoor panorama during the inpainting process. Specifically, we take the low-level layout edges estimated from the input panorama as a prior to guide the inpainting model for recovering the global indoor structure. A plane-aware normalization module is employed to embed plane-wise style features derived from the layout into the generator, encouraging local texture restoration from adjacent room structures (i.e., ceiling, floor, and walls). Experimental results show that our work outperforms the current state-of-the-art methods on a public panoramic dataset in both qualitative and quantitative evaluations. Our code is available at https://ericsujw.github.io/LGPN-net/
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through atree representation
Look for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.