Adaptive Feature Selection for No-Reference Image Quality Assessment using Contrastive Mitigating Semantic Noise Sensitivity

AI-generated keywords: No-Reference Image Quality Assessment Feature Extraction Contrastive Learning Distillation Framework Performance Linear Correlation Coefficient

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Current NR-IQA methods rely on feature extraction in upstream backbone networks
  • Not all extracted features are relevant and some may be harmful
  • Proposed Quality-Aware Feature Matching IQA metric (QFM-IQM) uses contrastive learning to remove harmful features
  • QFM-IQM compares image pairs with similar semantic features but varying quality scores
  • Adaptive adjustment of upstream task's features mitigates negative impact of irrelevant or harmful features
  • Distillation framework expands dataset and improves model's generalization ability
  • Experimental results show that QFM-IQM outperforms state-of-the-art NR-IQA methods on eight standard datasets
  • QFM-IQM achieves impressive Performance Linear Correlation Coefficient (PLCC) values compared to existing methods
  • QFM-IQM selectively utilizes relevant features while eliminating harmful ones for accurate image quality assessment
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Xudong Li, Timin Gao, Xiawu Zheng, Runze Hu, Jingyuan Zheng, Yunhang Shen, Ke Li, Yutao Liu, Pingyang Dai, Yan Zhang, Rongrong Ji

Abstract: The current state-of-the-art No-Reference Image Quality Assessment (NR-IQA) methods typically use feature extraction in upstream backbone networks, which assumes that all extracted features are relevant. However, we argue that not all features are beneficial, and some may even be harmful, necessitating careful selection. Empirically, we find that many image pairs with small feature spatial distances can have vastly different quality scores. To address this issue, we propose a Quality-Aware Feature Matching IQA metric(QFM-IQM) that employs contrastive learning to remove harmful features from the upstream task. Specifically, our approach enhances the semantic noise distinguish capabilities of neural networks by comparing image pairs with similar semantic features but varying quality scores and adaptively adjusting the upstream task's features by introducing disturbance. Furthermore, we utilize a distillation framework to expand the dataset and improve the model's generalization ability. Our approach achieves superior performance to the state-of-the-art NR-IQA methods on 8 standard NR-IQA datasets, achieving PLCC values of 0.932 (vs. 0.908 in TID2013) and 0.913 (vs. 0.894 in LIVEC).

Submitted to arXiv on 11 Dec. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2312.06158v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

The current state-of-the-art No-Reference Image Quality Assessment (NR-IQA) methods rely on feature extraction in upstream backbone networks, assuming that all extracted features are relevant. However, recent research argues that not all features are beneficial and some may even be harmful, necessitating careful selection. It has been observed empirically that many image pairs with small feature spatial distances can have significantly different quality scores. To address this issue, the authors propose a novel Quality-Aware Feature Matching IQA metric (QFM-IQM) that employs contrastive learning to remove harmful features from the upstream task. The approach enhances the semantic noise distinguish capabilities of neural networks by comparing image pairs with similar semantic features but varying quality scores. By adaptively adjusting the upstream task's features through introducing disturbance, the proposed method effectively mitigates the negative impact of irrelevant or harmful features. Furthermore, a distillation framework is utilized to expand the dataset and improve the model's generalization ability. This framework enables the model to learn from both original images and their corresponding distorted versions, enhancing its ability to assess image quality accurately. Experimental results demonstrate that the proposed approach outperforms state-of-the-art NR-IQA methods on eight standard NR-IQA datasets. It achieves impressive Performance Linear Correlation Coefficient (PLCC) values of 0.932 (compared to 0.908 in TID2013) and 0.913 (compared to 0.894 in LIVEC). These results highlight the effectiveness of QFM-IQM in accurately assessing image quality by selectively utilizing relevant features while eliminating harmful ones. In conclusion, this research presents an innovative approach for No-Reference Image Quality Assessment by introducing contrastive learning and adaptive feature selection techniques.
Created on 15 Dec. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.