A labeled dataset of simulated phlebotomy procedures for medical AI: polygon annotations for object detection and human-object interaction

Authors: Raúl Jiménez Cruz, César Torres-Huitzil, Marco Franceschetti, Ronny Seiger, Luciano García-Bañuelos, Barbara Weber

arXiv: 2602.04624v1 - DOI (cs.CV)

License: NONEXCLUSIVE-DISTRIB 1.0

AI-generated keywords: Dataset Medical Training Object Detection Human-Object Interaction AI-driven Solutions

AI-generated Key Points

⚠The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

Dataset contains 11,884 labeled images of a simulated blood extraction procedure on a training arm
Images were selected from high-definition videos and curated to eliminate redundancy using SSIM filtering
An automated face-anonymization process was implemented prior to frame selection
Each image is annotated with polygon outlines for five medical classes: syringe, rubber band, disinfectant wipe, gloves, and training arm
Annotations are compatible with object detection frameworks like YOLOv8
Dataset is divided into training (70%), validation (15%), and test (15%) subsets
Primary objective is to advance research in medical training automation and human-object interaction
Tasks enabled by the dataset include phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and creation of educational systems with structured feedback
Data and labels are available on Zenodo for transparency and accessibility to researchers

Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: This data article presents a dataset of 11,884 labeled images documenting a simulated blood extraction (phlebotomy) procedure performed on a training arm. Images were extracted from high-definition videos recorded under controlled conditions and curated to reduce redundancy using Structural Similarity Index Measure (SSIM) filtering. An automated face-anonymization step was applied to all videos prior to frame selection. Each image contains polygon annotations for five medically relevant classes: syringe, rubber band, disinfectant wipe, gloves, and training arm. The annotations were exported in a segmentation format compatible with modern object detection frameworks (e.g., YOLOv8), ensuring broad usability. This dataset is partitioned into training (70%), validation (15%), and test (15%) subsets and is designed to advance research in medical training automation and human-object interaction. It enables multiple applications, including phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and the development of educational systems that provide structured feedback to medical trainees. The data and accompanying label files are publicly available on Zenodo.

Submitted to arXiv on 04 Feb. 2026

Cite this paper (BibTeX)

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2602.04624v1

⚠This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

Comprehensive Summary
Key points
Layman's Summary
Blog article

This data article presents a comprehensive dataset of 11,884 labeled images capturing a simulated blood extraction (phlebotomy) procedure conducted on a training arm. The images were meticulously selected from high-definition videos recorded in controlled settings and underwent curation to eliminate redundancy using Structural Similarity Index Measure (SSIM) filtering. Prior to frame selection, an automated face-anonymization process was implemented across all videos. Each image in the dataset is annotated with polygon outlines for five essential medical classes: syringe, rubber band, disinfectant wipe, gloves, and the training arm itself. These annotations were exported in a segmentation format compatible with modern object detection frameworks like YOLOv8, ensuring broad applicability for various research purposes. The dataset is divided into three subsets: training (70%), validation (15%), and test (15%), facilitating robust model development and evaluation. Its primary objective is to advance research in medical training automation and human-object interaction by enabling tasks such as phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and the creation of educational systems that offer structured feedback to medical trainees. The availability of both the data and accompanying label files on Zenodo promotes transparency and accessibility for researchers interested in leveraging this resource. Authored by Raúl Jiménez Cruz, César Torres-Huitzil, Marco Franceschetti, Ronny Seiger,Luciano García-Bañuelos,and Barbara Weber,this dataset titled "A labeled dataset of simulated phlebotomy procedures for medical AI: polygon annotations for object detection and human-object interaction" serves as a valuable asset for advancing AI-driven solutions in healthcare education and practice.

Dataset contains 11,884 labeled images of a simulated blood extraction procedure on a training arm
Images were selected from high-definition videos and curated to eliminate redundancy using SSIM filtering
An automated face-anonymization process was implemented prior to frame selection
Each image is annotated with polygon outlines for five medical classes: syringe, rubber band, disinfectant wipe, gloves, and training arm
Annotations are compatible with object detection frameworks like YOLOv8
Dataset is divided into training (70%), validation (15%), and test (15%) subsets
Primary objective is to advance research in medical training automation and human-object interaction
Tasks enabled by the dataset include phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and creation of educational systems with structured feedback
Data and labels are available on Zenodo for transparency and accessibility to researchers

SummaryA dataset is a collection of 11,884 labeled pictures showing how to take blood from a fake arm. The pictures were chosen from clear videos and made sure there were no extra ones. They also made sure no faces could be seen in the pictures. Each picture has outlines showing five medical things: syringe, rubber band, wipe, gloves, and the fake arm. The outlines can be used with special computer programs to find these things. Definitions- Dataset: A group of pictures or information collected for a specific purpose. - Annotated: Adding notes or marks to explain something. - Automation: Using machines or computers to do tasks automatically. - Object detection frameworks: Programs that can identify and locate objects in images or videos. - Transparency: Being open and clear about what is being done or shared. - Accessibility: Making something easy for people to use or get to.

Introduction

The use of artificial intelligence (AI) in healthcare has been gaining momentum in recent years, with the potential to revolutionize medical training and practice. One area where AI can have a significant impact is in phlebotomy, the process of extracting blood from patients for diagnostic or therapeutic purposes. To advance research in this field, a team of researchers led by Raúl Jiménez Cruz and César Torres-Huitzil has created a comprehensive dataset of labeled images capturing simulated phlebotomy procedures.

The Dataset

The dataset consists of 11,884 high-definition images captured from videos recorded in controlled settings. These videos were carefully selected and underwent curation to eliminate redundancy using Structural Similarity Index Measure (SSIM) filtering. Additionally, an automated face-anonymization process was implemented across all videos prior to frame selection. Each image in the dataset is annotated with polygon outlines for five essential medical classes: syringe, rubber band, disinfectant wipe, gloves, and the training arm itself. These annotations were exported in a segmentation format compatible with modern object detection frameworks like YOLOv8. This ensures that the dataset can be easily used for various research purposes such as phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and creating educational systems that offer structured feedback to medical trainees. To facilitate robust model development and evaluation, the dataset is divided into three subsets: training (70%), validation (15%), and test (15%). This division allows researchers to train their models on one subset and evaluate them on another without bias or overfitting.

Objective

The primary objective of this dataset is to advance research in medical training automation and human-object interaction by providing a valuable resource for developing AI-driven solutions. By offering detailed annotations for each image along with a large number of images, this dataset can aid in the development of algorithms that can accurately detect and recognize medical tools and their interactions with human subjects.

Authors

The dataset is authored by a team of researchers from various institutions, including Raúl Jiménez Cruz, César Torres-Huitzil, Marco Franceschetti, Ronny Seiger, Luciano García-Bañuelos, and Barbara Weber. Their expertise in computer vision and healthcare education makes them well-suited to create this valuable resource for the research community.

Benefits for Researchers

The availability of both the data and accompanying label files on Zenodo promotes transparency and accessibility for researchers interested in leveraging this resource. The detailed annotations provided with each image make it easy to use the dataset for various research purposes without having to manually label or annotate images. Additionally, the division into training, validation, and test subsets allows for unbiased model evaluation.

Conclusion

In conclusion, "A labeled dataset of simulated phlebotomy procedures for medical AI: polygon annotations for object detection and human-object interaction" serves as a valuable asset for advancing AI-driven solutions in healthcare education and practice. With its meticulously selected high-definition images and detailed annotations, this dataset has the potential to drive significant progress in medical training automation and human-object interaction research. Its availability on Zenodo ensures transparency and accessibility for all researchers interested in utilizing this resource.

Created on 05 Jun. 2026

Assess the quality of the AI-generated content by voting

Score: 0

Similar papers summarized with our AI tools

59.6%

Visual-Kinematics Graph Learning for Procedure-agnostic Instrument Tip Segmen…

cs.CV

57.1%

FUN-SIS: a Fully UNsupervised approach for Surgical Instrument Segmentation

cs.CV

57.0%

Automated Medical Device Display Reading Using Deep Learning Object Detection

cs.CV

56.3%

A Nasal Cytology Dataset for Object Detection and Deep Learning

cs.CV

54.6%

Deep Learning-based Biological Anatomical Landmark Detection in Colonoscopy V…

cs.CV

54.1%

CLIP in Medical Imaging: A Comprehensive Survey

cs.CV

54.1%

Text Promptable Surgical Instrument Segmentation with Vision-Language Models

cs.CV

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm compares the title and abstract of this paper with all the papers of the same arXiv category that we have summarized, and finds the closest ones. You can rerun it from time to time: the results improve as our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.