Generative Image Inpainting with Contextual Attention

AI-generated keywords: Image Inpainting Deep Learning Convolutional Neural Networks Contextual Attention Texture Synthesis

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Recent deep learning approaches have shown promising results on image inpainting
  • Traditional texture and patch synthesis approaches are better suited for borrowing textures from surrounding regions and utilizing surrounding image features as references during network training
  • This paper presents a novel deep learning-based approach that incorporates contextual attention and borrowing information from surrounding regions
  • The model is a feed-forward, fully convolutional neural network that can process images with multiple holes at arbitrary locations and variable sizes during test time
  • Experiments were conducted on multiple datasets including faces, textures, and natural images to evaluate the proposed approach
  • Results demonstrate that the method generates higher-quality inpainting results compared to existing approaches
  • The authors will release the code and trained models for further research and application
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas S. Huang

technical report

Abstract: Recent deep learning based approaches have shown promising results on image inpainting for the challenging task of filling in large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create distorted structures or blurry textures inconsistent with surrounding areas. This is mainly due to ineffectiveness of convolutional neural networks in explicitly borrowing or copying information from distant spatial locations. On the other hand, traditional texture and patch synthesis approaches are particularly suitable when it needs to borrow textures from the surrounding regions. Motivated by these observations, we propose a new deep generative model-based approach which can not only synthesize novel image structures but also explicitly utilize surrounding image features as references during network training to make better predictions. The model is a feed-forward, fully convolutional neural network which can process images with multiple holes at arbitrary locations and with variable sizes during the test time. Experiments on multiple datasets including faces, textures and natural images demonstrate that the proposed approach generates higher-quality inpainting results than existing ones. Code and trained models will be released.

Submitted to arXiv on 24 Jan. 2018

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 1801.07892v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

Recent deep learning based approaches have shown promising results on image inpainting, which involves filling in large missing regions in an image. Traditional texture and patch synthesis approaches are better suited for borrowing textures from surrounding regions and explicitly utilizing surrounding image features as references during network training to make better predictions. To address the limitations of previous methods, this paper presents a novel deep learning-based approach that incorporates contextual attention and borrowing information from surrounding regions. The model is a feed-forward, fully convolutional neural network that can process images with multiple holes at arbitrary locations and variable sizes during test time. The authors conduct experiments on multiple datasets including faces, textures, and natural images to evaluate the proposed approach. The results demonstrate that their method generates higher-quality inpainting results compared to existing approaches. They also mention that they will release the code and trained models for further research and application. In summary, this paper presents an effective approach for image inpainting that produces visually plausible and high-quality results across various datasets.
Created on 12 Nov. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.