Results of the summarizing process for the arXiv paper: 2602.04624v1

This data article presents a comprehensive dataset of 11,884 labeled images capturing a simulated blood extraction (phlebotomy) procedure conducted on a training arm. The images were meticulously selected from high-definition videos recorded in controlled settings and underwent curation to eliminate redundancy using Structural Similarity Index Measure (SSIM) filtering. Prior to frame selection, an automated face-anonymization process was implemented across all videos. Each image in the dataset is annotated with polygon outlines for five essential medical classes: syringe, rubber band, disinfectant wipe, gloves, and the training arm itself. These annotations were exported in a segmentation format compatible with modern object detection frameworks like YOLOv8, ensuring broad applicability for various research purposes. The dataset is divided into three subsets: training (70%), validation (15%), and test (15%), facilitating robust model development and evaluation. Its primary objective is to advance research in medical training automation and human-object interaction by enabling tasks such as phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and the creation of educational systems that offer structured feedback to medical trainees. The availability of both the data and accompanying label files on Zenodo promotes transparency and accessibility for researchers interested in leveraging this resource. Authored by Raúl Jiménez Cruz, César Torres-Huitzil, Marco Franceschetti, Ronny Seiger,Luciano García-Bañuelos,and Barbara Weber,this dataset titled "A labeled dataset of simulated phlebotomy procedures for medical AI: polygon annotations for object detection and human-object interaction" serves as a valuable asset for advancing AI-driven solutions in healthcare education and practice.

• - Dataset contains 11,884 labeled images of a simulated blood extraction procedure on a training arm
• - Images were selected from high-definition videos and curated to eliminate redundancy using SSIM filtering
• - An automated face-anonymization process was implemented prior to frame selection
• - Each image is annotated with polygon outlines for five medical classes: syringe, rubber band, disinfectant wipe, gloves, and training arm
• - Annotations are compatible with object detection frameworks like YOLOv8
• - Dataset is divided into training (70%), validation (15%), and test (15%) subsets
• - Primary objective is to advance research in medical training automation and human-object interaction
• - Tasks enabled by the dataset include phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and creation of educational systems with structured feedback
• - Data and labels are available on Zenodo for transparency and accessibility to researchers

SummaryA dataset is a collection of 11,884 labeled pictures showing how to take blood from a fake arm. The pictures were chosen from clear videos and made sure there were no extra ones. They also made sure no faces could be seen in the pictures. Each picture has outlines showing five medical things: syringe, rubber band, wipe, gloves, and the fake arm. The outlines can be used with special computer programs to find these things. Definitions- Dataset: A group of pictures or information collected for a specific purpose. - Annotated: Adding notes or marks to explain something. - Automation: Using machines or computers to do tasks automatically. - Object detection frameworks: Programs that can identify and locate objects in images or videos. - Transparency: Being open and clear about what is being done or shared. - Accessibility: Making something easy for people to use or get to.

Introduction

The use of artificial intelligence (AI) in healthcare has been gaining momentum in recent years, with the potential to revolutionize medical training and practice. One area where AI can have a significant impact is in phlebotomy, the process of extracting blood from patients for diagnostic or therapeutic purposes. To advance research in this field, a team of researchers led by Raúl Jiménez Cruz and César Torres-Huitzil has created a comprehensive dataset of labeled images capturing simulated phlebotomy procedures.

The Dataset

The dataset consists of 11,884 high-definition images captured from videos recorded in controlled settings. These videos were carefully selected and underwent curation to eliminate redundancy using Structural Similarity Index Measure (SSIM) filtering. Additionally, an automated face-anonymization process was implemented across all videos prior to frame selection. Each image in the dataset is annotated with polygon outlines for five essential medical classes: syringe, rubber band, disinfectant wipe, gloves, and the training arm itself. These annotations were exported in a segmentation format compatible with modern object detection frameworks like YOLOv8. This ensures that the dataset can be easily used for various research purposes such as phlebotomy tool detection, procedural step recognition, workflow analysis, conformance checking, and creating educational systems that offer structured feedback to medical trainees. To facilitate robust model development and evaluation, the dataset is divided into three subsets: training (70%), validation (15%), and test (15%). This division allows researchers to train their models on one subset and evaluate them on another without bias or overfitting.

Objective

The primary objective of this dataset is to advance research in medical training automation and human-object interaction by providing a valuable resource for developing AI-driven solutions. By offering detailed annotations for each image along with a large number of images, this dataset can aid in the development of algorithms that can accurately detect and recognize medical tools and their interactions with human subjects.

Authors

The dataset is authored by a team of researchers from various institutions, including Raúl Jiménez Cruz, César Torres-Huitzil, Marco Franceschetti, Ronny Seiger, Luciano García-Bañuelos, and Barbara Weber. Their expertise in computer vision and healthcare education makes them well-suited to create this valuable resource for the research community.

Benefits for Researchers

The availability of both the data and accompanying label files on Zenodo promotes transparency and accessibility for researchers interested in leveraging this resource. The detailed annotations provided with each image make it easy to use the dataset for various research purposes without having to manually label or annotate images. Additionally, the division into training, validation, and test subsets allows for unbiased model evaluation.

Conclusion

In conclusion, "A labeled dataset of simulated phlebotomy procedures for medical AI: polygon annotations for object detection and human-object interaction" serves as a valuable asset for advancing AI-driven solutions in healthcare education and practice. With its meticulously selected high-definition images and detailed annotations, this dataset has the potential to drive significant progress in medical training automation and human-object interaction research. Its availability on Zenodo ensures transparency and accessibility for all researchers interested in utilizing this resource.