PROB: Probabilistic Objectness for Open World Object Detection

AI-generated keywords: Open World Object Detection Probabilistic Framework Novel Objects Incremental Learning Performance

AI-generated Key Points

  • Open World Object Detection (OWOD) aims to bridge the gap between traditional object detection benchmarks and real-world scenarios
  • OWOD algorithms need to detect and learn about novel or unknown objects
  • Standard object detection methods fail in OWOD due to the lack of supervision in distinguishing unknown objects from background proposals
  • Previous approaches using pseudo-labeling techniques have low performance in unknown object detection
  • The authors propose a novel probabilistic framework called Probabilistic Objectness (PROB) for estimating the likelihood of objectness
  • PROB alternates between probability distribution estimation and maximizing the objectness likelihood of known objects in an embedded feature space
  • PROB integrates this probabilistic framework into traditional object detection models, adapting them for open-world settings
  • Comprehensive experiments show that PROB outperforms existing methods in both unknown object detection and known object detection
  • PROB's incremental learning performance is evaluated on PASCAL VOC 2007 benchmark, demonstrating its effectiveness in adapting to new objects over time
  • This work presents a promising approach for open-world object detection by leveraging a probabilistic framework that improves both known and unknown object detection performance
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Orr Zohar, Kuan-Chieh Wang, Serena Yeung

License: CC BY 4.0

Abstract: Open World Object Detection (OWOD) is a new and challenging computer vision task that bridges the gap between classic object detection (OD) benchmarks and object detection in the real world. In addition to detecting and classifying seen/labeled objects, OWOD algorithms are expected to detect novel/unknown objects - which can be classified and incrementally learned. In standard OD, object proposals not overlapping with a labeled object are automatically classified as background. Therefore, simply applying OD methods to OWOD fails as unknown objects would be predicted as background. The challenge of detecting unknown objects stems from the lack of supervision in distinguishing unknown objects and background object proposals. Previous OWOD methods have attempted to overcome this issue by generating supervision using pseudo-labeling - however, unknown object detection has remained low. Probabilistic/generative models may provide a solution for this challenge. Herein, we introduce a novel probabilistic framework for objectness estimation, where we alternate between probability distribution estimation and objectness likelihood maximization of known objects in the embedded feature space - ultimately allowing us to estimate the objectness probability of different proposals. The resulting Probabilistic Objectness transformer-based open-world detector, PROB, integrates our framework into traditional object detection models, adapting them for the open-world setting. Comprehensive experiments on OWOD benchmarks show that PROB outperforms all existing OWOD methods in both unknown object detection ($\sim 2\times$ unknown recall) and known object detection ($\sim 10\%$ mAP). Our code will be made available upon publication at https://github.com/orrzohar/PROB.

Submitted to arXiv on 02 Dec. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2212.01424v1

Open World Object Detection (OWOD) is a challenging computer vision task that aims to bridge the gap between traditional object detection benchmarks and real-world object detection scenarios. In addition to detecting and classifying known objects, OWOD algorithms are expected to detect and learn about novel or unknown objects. However, applying standard object detection methods to OWOD fails because unknown objects are often predicted as background due to the lack of supervision in distinguishing them from background object proposals. Previous approaches have attempted to address this issue by using pseudo-labeling techniques, but the performance of unknown object detection remains low. To overcome this challenge, the authors propose a novel probabilistic framework called Probabilistic Objectness (PROB) for estimating the likelihood of objectness. The framework alternates between probability distribution estimation and maximizing the objectness likelihood of known objects in an embedded feature space. This allows for estimating the objectness probability of different proposals. The resulting PROB model integrates this probabilistic framework into traditional object detection models, adapting them for open-world settings. The authors conduct comprehensive experiments on OWOD benchmarks and show that PROB outperforms existing methods in both unknown object detection (approximately 2 times higher recall) and known object detection (approximately 10% higher mean average precision). In addition, the authors evaluate PROB's incremental learning performance on the PASCAL VOC 2007 benchmark compared to other OWOD and incremental learning methods. The results demonstrate the effectiveness of PROB in adapting to new objects over time. Overall, this work presents a promising approach for addressing the challenge of open-world object detection by leveraging a probabilistic framework that improves both known and unknown object detection performance. The code for PROB will be made available upon publication at https://github.com/orrzohar/PROB.
Created on 21 Jan. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.