Résumé IA · arXiv: 1903.11027v5 · cs.LG

nuScenes: A multimodal dataset for autonomous driving

Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan,
et 2 autres auteursGiancarlo Baldan, Oscar Beijbom
Article original · DOI 10.1109/cvpr42600.2020.01164 Soumis à arXiv le 26 Mar. 2019 Publié dans 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (juin 2020) CVPR 2020 camera ready incl. supplementary material Licence : NONEXCLUSIVE-DISTRIB 1.0 Aussi en : en

Comment lire ce résumé ? Guide illustré

Pour aller plus loin

  • Résumé Complet
  • Résumé vulgarisé
  • Article de blog
  • Abstract original
Le résumé n'est pas encore prêt

Cette synthèse vous a-t-elle été utile ?

Note : 0

Pourquoi avons-nous besoin de votes ?

Les votes sont utilisés pour déterminer si nous devons réexécuter nos outils de synthèse. Si le compte atteint -10, nos outils peuvent être redémarrés.

Figures et graphiques

Posez une question sur une figure en indiquant son numéro ou en utilisant son bouton de question pour demander une analyse visuelle. Au maximum deux figures et quatre panneaux par question. Les valeurs lues sur les graphiques sont approximatives ; vérifiez les données originales.

Instructions pour utiliser l'assistant IA ?

Outils pour cet article

Expliquer autrement 1 réécriture gratuite restante aujourd'hui
Enregistrer dans une collection Regroupez des articles en collections pour les comparer, les interroger et les exporter. Continuer avec Google Créer un compte gratuit Se connecter

Outils avancés Premium

Pour suivre un domaine de près : alertes de citations, diapositives de journal club, comparaison des versions et envoi vers Zotero. Découvrir Premium

Zotero Guide Zotero
Alertes de citation Plus de 300 articles le citent déjà : recevez chaque nouveau par email. Guide des alertes de citations
Qui travaille dessus ?

Parmi les 31 articles autour de celui-ci, le nom qui revient le plus : Andreas Geiger (2 articles)

3 autres personnes en signent plusieurs. La carte complète ajoute leurs institutions et leurs approches, d’après les articles des dernières années.

Continuer avec Google Créez un compte gratuit : votre première carte est offerte
Lettre hebdomadaire La dernière lettre de son domaine, « Intelligence artificielle cette semaine » du 16 novembre 2026 : Intelligence artificielle cette semaine : ce que les bons scores ne disent pas · En recevoir une par email gratuitement

Les articles autour de celui-ci

Les voir sur une carte

Classés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.

Les articles les plus proches

  1. Très proche
    OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Driving
    Lian-Qing Zheng, Long Yang, Qunshu Lin et al. · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence · cité 36 fois · Pas encore résumé
    Résumé scientifique

    The rapid advancement of deep learning has intensified the need for comprehensive data for use by autonomous driving algorithms. High-quality datasets are crucial for the development of effective data-driven autonomous driving solutions. Next-generation autonomous driving datasets must be multimodal, incorporating data from advanced sensors that feature extensive data coverage, detailed annotations, and diverse scene representation. To address this need, we present OmniHD-Scenes, a large-scale multimodal dataset that provides comprehensive omnidirectional high-definition data. The OmniHD-Scenes dataset combines data from 128-beam LiDAR, six cameras, and six 4D imaging radar systems to achiev…

  2. Très proche
    nuScenes Revisited: Progress and Challenges in Autonomous Driving
    Whye Kit Fong, Venice Erin Liong, K. Tan et al. · 2025 · arXiv.org · preprint, non relu par les pairs · cité 5 fois · Pas encore résumé
    Résumé scientifique

    Autonomous Vehicles (AV) and Advanced Driver Assistance Systems (ADAS) have been revolutionized by Deep Learning. As a data-driven approach, Deep Learning relies on vast amounts of driving data, typically labeled in great detail. As a result, datasets, alongside hardware and algorithms, are foundational building blocks for the development of AVs. In this work we revisit one of the most widely used autonomous driving datasets: the nuScenes dataset. nuScenes exemplifies key trends in AV development, being the first dataset to include radar data, to feature diverse urban driving scenes from two continents, and to be collected using a fully autonomous vehicle operating on public roads, while als…

  3. Très proche
    aiMotive Dataset: A Multimodal Dataset for Robust Autonomous Driving with Long-Range Perception
    Tamás Matuszka, Iván Barton, Ádám Butykai et al. · 2022 · Computer Vision and Pattern Recognition · preprint, non relu par les pairs · cité 44 fois · Résumé IA disponible
    Résumé scientifique

    Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal datasets are accessible, they mainly comprise two sensor modalities (camera, LiDAR) which are not well suited for adverse weather. In addition, they lack far-range annotations, making it harder to train neural networks that are the base of a highway assistant function of an autonomous vehicle. Therefore, we introduce a multimodal dataset for robust autonomous driving with long-range perception. The dataset consists of 176 scenes with synchronized and calibr…

  4. Très proche Cite cet article
    A Unified Benchmark for Aerial-Enhanced Autonomous Driving: The KITScenes Aerial Dataset
    Daniel Lengerer, Richard Schwarzkopf, Jonas Merkert et al. · 2026 · Pas encore résumé
    Résumé scientifique

    Aerial imagery provides complementary spatial context for autonomous driving by exposing road structure beyond the immediate perception range of onboard sensors. Yet map construction from aerial imagery, aerial-assisted online HD mapping, and cross-view localization are typically studied on separate data and benchmarks. We introduce KITScenes Aerial, an extension of the KITScenes Multimodal dataset that augments synchronized onboard sensor data, vehicle poses, and rich Lanelet2 map annotations with spatially associated aerial imagery and higher-resolution neural representations, providing a common basis for a variety of research tasks. Our mapping evaluation focuses on all 53 KITScenes map c…

  5. Très proche
    MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditions
    F. Fent, Fabian Kuttenreich, Florian Ruch et al. · 2024 · Neural Information Processing Systems · cité 65 fois · Pas encore résumé
    Résumé scientifique

    Autonomous trucking is a promising technology that can greatly impact modern logistics and the environment. Ensuring its safety on public roads is one of the main duties that requires an accurate perception of the environment. To achieve this, machine learning methods rely on large datasets, but to this day, no such datasets are available for autonomous trucks. In this work, we present MAN TruckScenes, the first multimodal dataset for autonomous trucking. MAN TruckScenes allows the research community to come into contact with truck-specific challenges, such as trailer occlusions, novel sensor perspectives, and terminal environments for the first time. It comprises more than 740 scenes of 20s…

  6. Très proche
    NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario
    Tianwen Qian, Jingjing Chen, Linhai Zhuo et al. · 2023 · Computer Vision and Pattern Recognition · cité 432 fois · Résumé IA disponible
    Résumé scientifique

    We introduce a novel visual question answering (VQA) task in the context of autonomous driving, aiming to answer natural language questions based on street-view clues. Compared to traditional VQA tasks, VQA in autonomous driving scenario presents more challenges. Firstly, the raw visual data are multi-modal, including images and point clouds captured by camera and LiDAR, respectively. Secondly, the data are multi-frame due to the continuous, real-time acquisition. Thirdly, the outdoor scenes exhibit both moving foreground and static background. Existing VQA benchmarks fail to adequately address these complexities. To bridge this gap, we propose NuScenes-QA, the first benchmark for VQA in the…

  7. Très proche Cité par cet article
    A*3D Dataset: Towards Autonomous Driving in Challenging Environments
    Quang-Hieu Pham, P. Sevestre, R. Pahwa et al. · 2019 · IEEE International Conference on Robotics and Automation · cité 190 fois · Pas encore résumé
    Résumé scientifique

    With the increasing global popularity of self-driving cars, there is an immediate need for challenging real-world datasets for benchmarking and training various computer vision tasks such as 3D object detection. Existing datasets either represent simple scenarios or provide only day-time data. In this paper, we introduce a new challenging A*3D dataset which consists of RGB images and LiDAR data with a significant diversity of scene, time, and weather. The dataset consists of high-density images (≈ 10 times more than the pioneering KITTI dataset), heavy occlusions, a large number of nighttime frames (≈ 3 times the nuScenes dataset), addressing the gaps in the existing datasets to push the bou…

  8. Très proche
    One Million Scenes for Autonomous Driving: ONCE Dataset
    Jiageng Mao, Minzhe Niu, Chenhan Jiang et al. · 2021 · NeurIPS Datasets and Benchmarks · cité 402 fois · Pas encore résumé
    Résumé scientifique

    Current perception models in autonomous driving have become notorious for greatly relying on a mass of annotated data to cover unseen cases and address the long-tail problem. On the other hand, learning from unlabeled large-scale collected data and incrementally self-training powerful recognition models have received increasing attention and may become the solutions of next-generation industry-level powerful and robust perception models in autonomous driving. However, the research community generally suffered from data inadequacy of those essential real-world scene data, which hampers the future exploration of fully/semi/self-supervised methods for 3D perception. In this paper, we introduce …

Les travaux antérieurs sur lesquels il s’appuie

  1. Proche Utilisé en profondeur par cet article Une méthode qu’il utilise
    The ApolloScape Open Dataset for Autonomous Driving and Its Application
    Xin-Yu Huang, Peng Wang, Xinjing Cheng et al. · 2018 · IEEE Transactions on Pattern Analysis and Machine Intelligence · cité 692 fois · Pas encore résumé
    Résumé scientifique

    Autonomous driving has attracted tremendous attention especially in the past few years. The key techniques for a self-driving car include solving tasks like 3D map construction, self-localization, parsing the driving road and understanding objects, which enable vehicles to reason and act. However, large scale data set for training and system evaluation is still a bottleneck for developing robust perception models. In this paper, we present the ApolloScape dataset [1] and its applications for autonomous driving. Compared with existing public datasets from real scenes, e.g., KITTI [2] or Cityscapes [3] , ApolloScape contains much large and richer labelling including holistic semantic dense poi…

  2. Proche Utilisé en profondeur par cet article Une méthode qu’il utilise
    The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
    Abhishek Patil, Srikanth Malla, Hai-Ming Gang et al. · 2019 · IEEE International Conference on Robotics and Automation · cité 265 fois · Pas encore résumé
    Résumé scientifique

    3D multi-object detection and tracking are crucial for traffic scene understanding. However, the community pays less attention to these areas due to the lack of a standardized benchmark dataset to advance the field. Moreover, existing datasets (e.g., KITTI [1]) do not provide sufficient data and labels to tackle challenging scenes where highly interactive and occluded traffic participants are present. To address the issues, we present the Honda Research Institute 3D Dataset (H3D), a large-scale full-surround 3D multi-object detection and tracking dataset collected using a 3D LiDAR scanner. H3D comprises of 160 crowded and highly interactive traffic scenes with a total of 1 million labeled in…

  3. Proche Utilisé en profondeur par cet article Une méthode qu’il utilise
    The Cityscapes Dataset for Semantic Urban Scene Understanding
    Marius Cordts, Mohamed Omran, Sebastian Ramos et al. · 2016 · Computer Vision and Pattern Recognition · cité 14 475 fois · Pas encore résumé
    Résumé scientifique

    Visual understanding of complex urban street scenes is an enabling factor for a wide range of applications. Object detection has benefited enormously from large-scale datasets, especially in the context of deep learning. For semantic urban scene understanding, however, no current dataset adequately captures the complexity of real-world urban scenes. To address this, we introduce Cityscapes, a benchmark suite and large-scale dataset to train and test approaches for pixel-level and instance-level semantic labeling. Cityscapes is comprised of a large, diverse set of stereo video sequences recorded in streets from 50 different cities. 5000 of these images have high quality pixel-level annotation…

  4. Proche* Une méthode qu’il utilise
    KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving
    Yukyung Choi, Namil Kim, Soonmin Hwang et al. · 2018 · IEEE transactions on intelligent transportation systems (Print) · cité 362 fois · Pas encore résumé
  5. Proche
    Probabilistic 3D Multi-Object Tracking for Autonomous Driving
    Hsu-kuang Chiu, Antonio Prioletti, Jie Li et al. · 2020 · arXiv.org · preprint, non relu par les pairs · cité 154 fois · Pas encore résumé
    Résumé scientifique

    3D multi-object tracking is a key module in autonomous driving applications that provides a reliable dynamic representation of the world to the planning module. In this paper, we present our on-line tracking method, which made the first place in the NuScenes Tracking Challenge, held at the AI Driving Olympics Workshop at NeurIPS 2019. Our method estimates the object states by adopting a Kalman Filter. We initialize the state covariance as well as the process and observation noise covariance with statistics from the training set. We also use the stochastic information from the Kalman Filter in the data association step by measuring the Mahalanobis distance between the predicted object states …

Les articles qui le citent

  1. Proche
    Scalability in Perception for Autonomous Driving: Waymo Open Dataset
    Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla et al. · 2019 · Computer Vision and Pattern Recognition · cité 4 635 fois · Pas encore résumé
    Résumé scientifique

    The research community has increasing interest in autonomous driving research, despite the resource intensity of obtaining representative real world data. Existing self-driving datasets are limited in the scale and variation of the environments they capture, even though generalization within and between operating regions is crucial to the over-all viability of the technology. In an effort to help align the research community’s contributions with real-world self-driving problems, we introduce a new large scale, high quality, diverse dataset. Our new dataset consists of 1150 scenes that each span 20 seconds, consisting of well synchronized and calibrated high quality LiDAR and camera data capt…

  2. Proche Utilise cet article en profondeur
    LynxScenes: A Large-Scale Real-World Benchmark for Outdoor Wheel-Legged Robot Perception, Navigation, Imagination and Reconstruction
    Jun Tian, Hao-Rui Wu, Ruo Chen et al. · 2026 · Pas encore résumé
    Résumé scientifique

    Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, and scene reconstruction. However, existing datasets typically support these capabilities in isolation and rarely provide dense spatial and behavior-level supervision on real wheel-legged platforms. We introduce LynxScenes, a large-scale real-world dataset and benchmark collected with a LYNX M20 wheel-legged robot. It contains approximately 100K 30-s navigation clips spanning 833.6 h and 3,294.7 km, with 3.0M annotated frames. The synchronized recordings include four fisheye cameras, dual LiDARs, IMU, odometry, and robot states. Annotations co…

  3. Proche Utilise cet article en profondeur
    PanoBench: A Panoptic Occupancy Prediction Benchmark for Autonomous Driving
    Yi Feng, Zi-Zhan Guo, E. Junwu et al. · 2026 · Pas encore résumé
    Résumé scientifique

    Panoptic occupancy unifies 3D geometry, semantics, and instance identities, but its development is limited by scarce instance-aware annotations. Existing benchmarks mainly provide semantic labels reconstructed from incomplete sensor observations, while panoptic datasets have limited domain coverage or annotation completeness. We introduce PanoBench, a camera-centric panoptic occupancy prediction benchmark spanning synthetic and real-world driving scenes. It combines PanoBench-CarlaOcc, PanoBench-nuScenes, and PanoBench-KITTI360 through canonical data interfaces and unified evaluation protocols, providing multi-resolution annotations with persistent instance identities. The synthetic branch d…

  4. Proche Cité par cet article
    Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
    Di Feng, Christian Haase-Schütz, Lars Rosenbaum et al. · 2019 · IEEE transactions on intelligent transportation systems (Print) · cité 1 423 fois · Pas encore résumé
    Résumé scientifique

    Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs, Radars), and multiple sensing modalities can be fused to exploit their complementary properties. In this context, many methods have been proposed for deep multi-modal perception problems. However, there is no general guideline for network architecture design, and questions of “what to fuse”, “when to fuse”, and “how to fuse” remain open. This review paper attempts to systematically summarize methodologies and discuss challenges for deep multi-modal object detect…

  5. Proche Utilise cet article en profondeur
    Adversarial Robustness of Camera-Radar Sensor Fusion for Autonomous Driving
    Ce Zhou, Yu-Bo Wu, K. Nguyen et al. · 2026 · Pas encore résumé
    Résumé scientifique

    Autonomous driving (AD) relies on multi-sensor perception to interpret the surrounding environment. However, the robustness of camera--radar fusion under adversarial conditions remains largely unexplored. This paper presents a systematic measurement study of the robustness of camera--radar sensor fusion in AD. We construct a unified evaluation pipeline on the nuScenes dataset that simulates attacks on both sensing modalities, including eight camera-image perturbations and three radar point-cloud perturbations. We evaluate five camera--radar fusion algorithms across two perception tasks, 3D object detection and depth estimation, and quantify their performance under clean and attacked inputs u…

Comment ces articles sont-ils trouvés ?

Nous comparons le titre et le résumé de cet article avec ceux de tous les articles résumés sur ce site, et avec les articles que Semantic Scholar recommande, ceux qu’il cite et ceux qui le citent (pour un article très cité, ses citations les plus récentes et, depuis OpenAlex, les plus citées). Parmi les travaux antérieurs et les suites, les articles qui s’utilisent en profondeur, une méthode qu’il utilise et les suites très citées remontent un peu. Les niveaux (très proche, proche, apparenté) viennent de la similarité des textes, pas d’un jugement de qualité ; * signale un article sans résumé, comparé par son titre. La phrase sous un article est écrite par une IA à partir des deux résumés : vérifiez-la dans les articles. Un article jugé hors sujet par trois lecteurs quitte la liste.

Mis à jour le 1 novembre 2026.

Le guide illustré des articles autour d’un article

Le résumé précédent a été créé il y a plus d'un an et peut être réexécuté (si nécessaire) en cliquant sur le bouton Exécuter ci-dessous.

Avertissement : Notre outil de synthèse basé sur l'IA et l'assistant virtuel fournis sur ce site Web peuvent ne pas toujours fournir des résumés complets ou des réponses exactes. Nous vous encourageons à examiner attentivement et à évaluer le contenu généré pour vous assurer de sa qualité et de sa pertinence par rapport à vos besoins.