PROB: Probabilistic Objectness for Open World Object Detection
AI-generated Key Points
- Open World Object Detection (OWOD) aims to bridge the gap between traditional object detection benchmarks and real-world scenarios
- OWOD algorithms need to detect and learn about novel or unknown objects
- Standard object detection methods fail in OWOD due to the lack of supervision in distinguishing unknown objects from background proposals
- Previous approaches using pseudo-labeling techniques have low performance in unknown object detection
- The authors propose a novel probabilistic framework called Probabilistic Objectness (PROB) for estimating the likelihood of objectness
- PROB alternates between probability distribution estimation and maximizing the objectness likelihood of known objects in an embedded feature space
- PROB integrates this probabilistic framework into traditional object detection models, adapting them for open-world settings
- Comprehensive experiments show that PROB outperforms existing methods in both unknown object detection and known object detection
- PROB's incremental learning performance is evaluated on PASCAL VOC 2007 benchmark, demonstrating its effectiveness in adapting to new objects over time
- This work presents a promising approach for open-world object detection by leveraging a probabilistic framework that improves both known and unknown object detection performance
Authors: Orr Zohar, Kuan-Chieh Wang, Serena Yeung
Abstract: Open World Object Detection (OWOD) is a new and challenging computer vision task that bridges the gap between classic object detection (OD) benchmarks and object detection in the real world. In addition to detecting and classifying seen/labeled objects, OWOD algorithms are expected to detect novel/unknown objects - which can be classified and incrementally learned. In standard OD, object proposals not overlapping with a labeled object are automatically classified as background. Therefore, simply applying OD methods to OWOD fails as unknown objects would be predicted as background. The challenge of detecting unknown objects stems from the lack of supervision in distinguishing unknown objects and background object proposals. Previous OWOD methods have attempted to overcome this issue by generating supervision using pseudo-labeling - however, unknown object detection has remained low. Probabilistic/generative models may provide a solution for this challenge. Herein, we introduce a novel probabilistic framework for objectness estimation, where we alternate between probability distribution estimation and objectness likelihood maximization of known objects in the embedded feature space - ultimately allowing us to estimate the objectness probability of different proposals. The resulting Probabilistic Objectness transformer-based open-world detector, PROB, integrates our framework into traditional object detection models, adapting them for the open-world setting. Comprehensive experiments on OWOD benchmarks show that PROB outperforms all existing OWOD methods in both unknown object detection ($\sim 2\times$ unknown recall) and known object detection ($\sim 10\%$ mAP). Our code will be made available upon publication at https://github.com/orrzohar/PROB.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.