CANTraj: Recovering Vehicle Trajectories from CAN Signals in Naturalistic Driving
Authors: Yuhang Wang, Jingxin Yang, Chuheng Wei, Suyang Chen, Haozhuang Chi, Hao Zhou
Abstract
Open driving releases and usage-based insurance programs often claim to prevent privacy breaches by omitting GPS records when sharing or collecting vehicle data. However, removing GPS coordinates from driving logs does not erase the location information carried by vehicle signals. While prior route-inference attacks have demonstrated that speed, steering, and driving events can be matched to road networks to reconstruct trajectories, existing studies rely on inconsistent prior assumptions and evaluation metrics and are tested only on small, restricted datasets, making their results difficult to compare and their real-world effectiveness uncertain. We release CANTraj, a naturalistic driving dataset pairing decoded CAN events with time-aligned GNSS trajectories (3,940 drives, 454 drivers), and CANTraj-Bench for evaluating trajectory recovery (3,675 drives, 431 drivers, 1,380 hours, 85,919 km). On 776 evaluation drives from 94 unseen drivers, we compare six re-implemented attacks and benchmark baselines under explicit information-access protocols, paired comparisons, and metrics incorporating failures. Experiments show that combining steering signals with road-network constraints yields the largest gain: With a known start and heading, adding steering to speed raises the online map filter's five-minute route recovery from 56% to 87%, with a median average displacement error of 43 m versus 921 m for map-free dead reckoning. Offline beam search recovers 88% of test routes with the heading and 81% without it. Because methods fail on different windows, we also evaluate an LLM harness that selects among candidate routes on 659 five-minute windows; its best configuration recovers 79% of routes on test and 83% on few-shot, outperforming the best baseline on test and matching it on few-shot. Data and code at huggingface.co/datasets/HenryYHW/CANTraj and github.com/WangYuHang-cmd/GPS--CAN.
The papers around it, by date and closeness
Higher is closer to this paper; left is older. Lines join papers close to each other: groups of lines are sub-topics. Select a point to see why it is there. Back to the summary of this paper
Papers around this one
Ranked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
CAN Coach: Vehicular Control through Human Cyber-Physical SystemsM. Nice, S. Elmadani, R. Bhadani et al. · 2021 · Robotics · cited 16 times · AI summary available
CAN Coach uses CAN radar signals to provide driver feedback for longitudinal control, whereas CANTraj uses CAN signals to reconstruct vehicle routes.
Abstract
This work addresses whether a human-in-the-loop cyber-physical system (HCPS) can be effective in improving the longitudinal control of an individual vehicle in a traffic flow. We introduce the CAN Coach, which is a system that gives feedback to the human-in-the-loop using radar data (relative speed and position information to objects ahead) that is available on the controller area network (CAN). Using a cohort of six human subjects driving an instrumented vehicle, we compare the ability of the human-in-the-loop driver to achieve a constant time-gap control policy using only human-based visual perception to the car ahead, and by augmenting human perception with audible feedback from CAN senso…
-
Improving Autonomous Vehicle Mapping and Navigation in Work Zones Using Crowdsourcing Vehicle TrajectoriesHanlin Chen, Renyuan Luo, Yiheng Feng · 2023 · Robotics · preprint, not peer reviewed · cited 6 times · AI summary available
This work uses crowdsourced vehicle trajectories to improve mapping and navigation in work zones, while CANTraj studies recovering trajectories from CAN signals.
Abstract
Prevalent solutions for Connected and Autonomous vehicle (CAV) mapping include high definition map (HD map) or real-time Simultaneous Localization and Mapping (SLAM). Both methods only rely on vehicle itself (onboard sensors or embedded maps) and can not adapt well to temporarily changed drivable areas such as work zones. Navigating CAVs in such areas heavily relies on how the vehicle defines drivable areas based on perception information. Difficulties in improving perception accuracy and ensuring the correct interpretation of perception results are challenging to the vehicle in these situations. This paper presents a prototype that introduces crowdsourcing trajectories information into the …
-
Road Genome: A Topology Reasoning Benchmark for Scene Understanding in Autonomous DrivingHuijie Wang, Zhenbo Liu, Yang Li et al. · 2023 · Computer Vision and Pattern Recognition · cited 127 times · AI summary available
Road Genome benchmarks topology reasoning for autonomous-driving scene understanding, while CANTraj benchmarks recovery of vehicle trajectories from CAN signals.
Abstract
Understanding the complex traffic environment is crucial for self-driving vehicles. Existing benchmarks in autonomous driving mainly cast scene understanding as perception problems, e.g., perceiving lanelines with vanilla detection or segmentation methods. As such, we argue that the perception pipeline provides limited information for autonomous vehicles to drive in the right way, especially without the aid of high-definition (HD) map. For instance, following the wrong traffic signal at a complicated crossroad would lead to a catastrophic incident. By introducing Road Genome (OpenLane-V2), we intend to shift the community's attention and take a step further beyond perception - to the task of…
-
NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and BenchmarkingDaniel Dauner, Marcel Hallgarten, Tianyu Li et al. · 2024 · Computer Vision and Pattern Recognition · cited 549 times · AI summary available
NAVSIM benchmarks vision-based driving policies using data and non-reactive simulation, whereas CANTraj benchmarks trajectory recovery from CAN signals.
Abstract
Benchmarking vision-based driving policies is challenging. On one hand, open-loop evaluation with real data is easy, but these results do not reflect closed-loop performance. On the other, closed-loop evaluation is possible in simulation, but is hard to scale due to its significant computational demands. Further, the simulators available today exhibit a large domain gap to real data. This has resulted in an inability to draw clear conclusions from the rapidly growing body of research on end-to-end autonomous driving. In this paper, we present NAVSIM, a middle ground between these evaluation paradigms, where we use large datasets in combination with a non-reactive simulator to enable large-sc…
-
How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle TraversabilityMateo Guaman Castro, Samuel Triest, Wenshan Wang et al. · 2022 · Robotics · cited 118 times · AI summary available
This method learns off-road traversability costmaps from environmental data and terrain feedback, rather than reconstructing routes from CAN signals.
Abstract
Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to build an accurate physics model, or create informative labels to learn a model in a supervised manner, for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of incorporating robot velocity in the costmap prediction pipeline. We validate our method in multiple short and large-scale navigation tasks on a large, aut…
-
nuScenes: A multimodal dataset for autonomous drivingHolger Caesar, Varun Bankiti, Alex H. Lang et al. · 2019 · Machine Learning · cited 9,545 times · AI summary available
nuScenes provides multimodal autonomous-driving sensor data for training and evaluation, while CANTraj provides paired CAN signals and GNSS trajectories for recovery benchmarks.
Abstract
Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combination of cameras and range sensors such as lidar and radar. As machine learning based methods for detection and tracking become more prevalent, there is a need to train and evaluate such methods on datasets containing range sensor data along with images. In this work we present nuTonomy scenes (nuScenes), the first dataset to carry the full autonomous vehicle sensor suite: 6 camera…
-
Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active PerceptionZixu Zhang, Jaime F. Fisac · 2021 · Robotics · cited 95 times · AI summary available
This work plans safe autonomous-vehicle trajectories under occlusion, while CANTraj reconstructs trajectories from vehicle signals.
Abstract
Autonomous vehicles interacting with other traffic participants heavily rely on the perception and prediction of other agents' behaviors to plan safe trajectories. However, as occlusions limit the vehicle's perception ability, reasoning about potential hazards beyond the field-of-view is one of the most challenging issues in developing autonomous driving systems. This paper introduces a novel analytical approach that poses the problem of safe trajectory planning under occlusions as a hybrid zero-sum dynamic game between the autonomous vehicle (evader), and an initially hidden traffic participant (pursuer). Due to occlusions, the pursuer's state is initially unknown to the evader and may late…
-
Hidden Biases of End-to-End Driving ModelsBernhard Jaeger, Kashyap Chitta, Andreas Geiger · 2023 · Computer Vision and Pattern Recognition · cited 175 times · AI summary available
This work analyzes biases in end-to-end driving models and proposes alternatives, whereas CANTraj evaluates methods for reconstructing routes from CAN signals.
Abstract
End-to-end driving systems have recently made rapid progress, in particular on CARLA. Independent of their major contribution, they introduce changes to minor system components. Consequently, the source of improvements is unclear. We identify two biases that recur in nearly all state-of-the-art methods and are critical for the observed progress on CARLA: (1) lateral recovery via a strong inductive bias towards target point following, and (2) longitudinal averaging of multimodal waypoint predictions for slowing down. We investigate the drawbacks of these biases and identify principled alternatives. By incorporating our insights, we develop TF++, a simple end-to-end method that ranks first on …
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 16 November 2026.