CANTraj: Recovering Vehicle Trajectories from CAN Signals in Naturalistic Driving

Authors: Yuhang Wang, Jingxin Yang, Chuheng Wei, Suyang Chen, Haozhuang Chi, Hao Zhou

Submitted to arXiv on 13 Nov. 2026
Abstract

Open driving releases and usage-based insurance programs often claim to prevent privacy breaches by omitting GPS records when sharing or collecting vehicle data. However, removing GPS coordinates from driving logs does not erase the location information carried by vehicle signals. While prior route-inference attacks have demonstrated that speed, steering, and driving events can be matched to road networks to reconstruct trajectories, existing studies rely on inconsistent prior assumptions and evaluation metrics and are tested only on small, restricted datasets, making their results difficult to compare and their real-world effectiveness uncertain. We release CANTraj, a naturalistic driving dataset pairing decoded CAN events with time-aligned GNSS trajectories (3,940 drives, 454 drivers), and CANTraj-Bench for evaluating trajectory recovery (3,675 drives, 431 drivers, 1,380 hours, 85,919 km). On 776 evaluation drives from 94 unseen drivers, we compare six re-implemented attacks and benchmark baselines under explicit information-access protocols, paired comparisons, and metrics incorporating failures. Experiments show that combining steering signals with road-network constraints yields the largest gain: With a known start and heading, adding steering to speed raises the online map filter's five-minute route recovery from 56% to 87%, with a median average displacement error of 43 m versus 921 m for map-free dead reckoning. Offline beam search recovers 88% of test routes with the heading and 81% without it. Because methods fail on different windows, we also evaluate an LLM harness that selects among candidate routes on 659 five-minute windows; its best configuration recovers 79% of routes on test and 83% on few-shot, outperforming the best baseline on test and matching it on few-shot. Data and code at huggingface.co/datasets/HenryYHW/CANTraj and github.com/WangYuHang-cmd/GPS--CAN.

The papers around it, by date and closeness

Higher is closer to this paper; left is older. Lines join papers close to each other: groups of lines are sub-topics. Select a point to see why it is there. Back to the summary of this paper

How to read this map? Illustrated guide

Closest papers Prior work it builds on Papers that cite it

Papers around this one

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Close Broader context
    CAN Coach: Vehicular Control through Human Cyber-Physical Systems
    M. Nice, S. Elmadani, R. Bhadani et al. · 2021 · Robotics · cited 16 times · AI summary available

    CAN Coach uses CAN radar signals to provide driver feedback for longitudinal control, whereas CANTraj uses CAN signals to reconstruct vehicle routes.

    Abstract

    This work addresses whether a human-in-the-loop cyber-physical system (HCPS) can be effective in improving the longitudinal control of an individual vehicle in a traffic flow. We introduce the CAN Coach, which is a system that gives feedback to the human-in-the-loop using radar data (relative speed and position information to objects ahead) that is available on the controller area network (CAN). Using a cohort of six human subjects driving an instrumented vehicle, we compare the ability of the human-in-the-loop driver to achieve a constant time-gap control policy using only human-based visual perception to the car ahead, and by augmenting human perception with audible feedback from CAN senso…

  2. Close Broader context
    Improving Autonomous Vehicle Mapping and Navigation in Work Zones Using Crowdsourcing Vehicle Trajectories
    Hanlin Chen, Renyuan Luo, Yiheng Feng · 2023 · Robotics · preprint, not peer reviewed · cited 6 times · AI summary available

    This work uses crowdsourced vehicle trajectories to improve mapping and navigation in work zones, while CANTraj studies recovering trajectories from CAN signals.

    Abstract

    Prevalent solutions for Connected and Autonomous vehicle (CAV) mapping include high definition map (HD map) or real-time Simultaneous Localization and Mapping (SLAM). Both methods only rely on vehicle itself (onboard sensors or embedded maps) and can not adapt well to temporarily changed drivable areas such as work zones. Navigating CAVs in such areas heavily relies on how the vehicle defines drivable areas based on perception information. Difficulties in improving perception accuracy and ensuring the correct interpretation of perception results are challenging to the vehicle in these situations. This paper presents a prototype that introduces crowdsourcing trajectories information into the …

  3. Close Broader context
    Road Genome: A Topology Reasoning Benchmark for Scene Understanding in Autonomous Driving
    Huijie Wang, Zhenbo Liu, Yang Li et al. · 2023 · Computer Vision and Pattern Recognition · cited 127 times · AI summary available

    Road Genome benchmarks topology reasoning for autonomous-driving scene understanding, while CANTraj benchmarks recovery of vehicle trajectories from CAN signals.

    Abstract

    Understanding the complex traffic environment is crucial for self-driving vehicles. Existing benchmarks in autonomous driving mainly cast scene understanding as perception problems, e.g., perceiving lanelines with vanilla detection or segmentation methods. As such, we argue that the perception pipeline provides limited information for autonomous vehicles to drive in the right way, especially without the aid of high-definition (HD) map. For instance, following the wrong traffic signal at a complicated crossroad would lead to a catastrophic incident. By introducing Road Genome (OpenLane-V2), we intend to shift the community's attention and take a step further beyond perception - to the task of…

  4. Related Broader context
    NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking
    Daniel Dauner, Marcel Hallgarten, Tianyu Li et al. · 2024 · Computer Vision and Pattern Recognition · cited 549 times · AI summary available

    NAVSIM benchmarks vision-based driving policies using data and non-reactive simulation, whereas CANTraj benchmarks trajectory recovery from CAN signals.

    Abstract

    Benchmarking vision-based driving policies is challenging. On one hand, open-loop evaluation with real data is easy, but these results do not reflect closed-loop performance. On the other, closed-loop evaluation is possible in simulation, but is hard to scale due to its significant computational demands. Further, the simulators available today exhibit a large domain gap to real data. This has resulted in an inability to draw clear conclusions from the rapidly growing body of research on end-to-end autonomous driving. In this paper, we present NAVSIM, a middle ground between these evaluation paradigms, where we use large datasets in combination with a non-reactive simulator to enable large-sc…

  5. Related Broader context
    How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability
    Mateo Guaman Castro, Samuel Triest, Wenshan Wang et al. · 2022 · Robotics · cited 118 times · AI summary available

    This method learns off-road traversability costmaps from environmental data and terrain feedback, rather than reconstructing routes from CAN signals.

    Abstract

    Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to build an accurate physics model, or create informative labels to learn a model in a supervised manner, for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of incorporating robot velocity in the costmap prediction pipeline. We validate our method in multiple short and large-scale navigation tasks on a large, aut…

  6. Related Shared data, tool or method
    nuScenes: A multimodal dataset for autonomous driving
    Holger Caesar, Varun Bankiti, Alex H. Lang et al. · 2019 · Machine Learning · cited 9,545 times · AI summary available

    nuScenes provides multimodal autonomous-driving sensor data for training and evaluation, while CANTraj provides paired CAN signals and GNSS trajectories for recovery benchmarks.

    Abstract

    Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combination of cameras and range sensors such as lidar and radar. As machine learning based methods for detection and tracking become more prevalent, there is a need to train and evaluate such methods on datasets containing range sensor data along with images. In this work we present nuTonomy scenes (nuScenes), the first dataset to carry the full autonomous vehicle sensor suite: 6 camera…

  7. Related Broader context
    Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception
    Zixu Zhang, Jaime F. Fisac · 2021 · Robotics · cited 95 times · AI summary available

    This work plans safe autonomous-vehicle trajectories under occlusion, while CANTraj reconstructs trajectories from vehicle signals.

    Abstract

    Autonomous vehicles interacting with other traffic participants heavily rely on the perception and prediction of other agents' behaviors to plan safe trajectories. However, as occlusions limit the vehicle's perception ability, reasoning about potential hazards beyond the field-of-view is one of the most challenging issues in developing autonomous driving systems. This paper introduces a novel analytical approach that poses the problem of safe trajectory planning under occlusions as a hybrid zero-sum dynamic game between the autonomous vehicle (evader), and an initially hidden traffic participant (pursuer). Due to occlusions, the pursuer's state is initially unknown to the evader and may late…

  8. Related Broader context
    Hidden Biases of End-to-End Driving Models
    Bernhard Jaeger, Kashyap Chitta, Andreas Geiger · 2023 · Computer Vision and Pattern Recognition · cited 175 times · AI summary available

    This work analyzes biases in end-to-end driving models and proposes alternatives, whereas CANTraj evaluates methods for reconstructing routes from CAN signals.

    Abstract

    End-to-end driving systems have recently made rapid progress, in particular on CARLA. Independent of their major contribution, they introduce changes to minor system components. Consequently, the source of improvements is unclear. We identify two biases that recur in nearly all state-of-the-art methods and are critical for the observed progress on CARLA: (1) lateral recovery via a strong inductive bias towards target point following, and (2) longitudinal averaging of multimodal waypoint predictions for slowing down. We investigate the drawbacks of these biases and identify principled alternatives. By incorporating our insights, we develop TF++, a simple end-to-end method that ranks first on …

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

Updated on 16 November 2026.

The illustrated guide to the papers around a paper