With foundation-model features, aggregator complexity does not improve cross-hospital discrimination in gastric whole-slide image classification

Classés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.

Les articles les plus proches

1. Proche Contexte plus large Pas pertinent

   Federated Model Aggregation via Self-Supervised Priors for Highly Imbalanced Medical Image Classification

   Marawan Elbatel, Hualiang Wang, Robert Martí et al. · 2023 · Computer Vision and Pattern Recognition · cité 11 fois · Résumé IA disponible

   Federated Model Aggregation étudie les variations entre clients médicaux avec des modèles auxiliaires, tandis que cet article compare des agrégateurs sur des hôpitaux non vus.

   Résumé scientifique

   In the medical field, federated learning commonly deals with highly imbalanced datasets, including skin lesions and gastrointestinal images. Existing federated methods under highly imbalanced datasets primarily focus on optimizing a global model without incorporating the intra-class variations that can arise in medical imaging due to different populations, findings, and scanners. In this paper, we study the inter-client intra-class variations with publicly available self-supervised auxiliary networks. Specifically, we find that employing a shared auxiliary pre-trained model, like MoCo-V2, locally on every client yields consistent divergence measurements. Based on these findings, we derive a …

2. Proche Données, outil ou méthode en commun Pas pertinent

   Virchow: A Million-Slide Digital Pathology Foundation Model

   Eugene Vorontsov, Alican Bozkurt, Adam Casson et al. · 2023 · Image and Video Processing · preprint, non relu par les pairs · cité 164 fois · Résumé IA disponible

   Virchow présente un modèle de fondation préentraîné sur des lames H&E, tandis que cet article évalue des agrégateurs sur des représentations issues de modèles de fondation.

   Résumé scientifique

   The use of artificial intelligence to enable precision medicine and decision support systems through the analysis of pathology images has the potential to revolutionize the diagnosis and treatment of cancer. Such applications will depend on models' abilities to capture the diverse patterns observed in pathology images. To address this challenge, we present Virchow, a foundation model for computational pathology. Using self-supervised learning empowered by the DINOv2 algorithm, Virchow is a vision transformer model with 632 million parameters trained on 1.5 million hematoxylin and eosin stained whole slide images from diverse tissue and specimen types, which is orders of magnitude more data t…

3. Proche Données, outil ou méthode en commun Pas pertinent

   PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stains

   Shengyi Hua, Fang Yan, Tianle Shen et al. · 2023 · Computer Vision and Pattern Recognition · preprint, non relu par les pairs · cité 42 fois · Résumé IA disponible

   PathoDuet préentraîne des modèles de fondation sur des images histopathologiques H&E et IHC, domaine de représentations utilisé pour la classification des lames.

   Résumé scientifique

   Large amounts of digitized histopathological data display a promising future for developing pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for downstream tasks. However, the gap between natural and histopathological images hinders the direct application of existing methods. In this work, we present PathoDuet, a series of pretrained models on histopathological images, and a new self-supervised learning framework in histopathology. The framework is featured by a newly-introduced pretext token and later task raisers to explicitly utilize certain relations between images, like multiple magnifications and …

4. Proche Autre approche du problème Pas pertinent

   Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning

   Jiawei Yang, Hanbo Chen, Jiangpeng Yan et al. · 2022 · Image and Video Processing · cité 28 fois · Résumé IA disponible

   Cette étude utilise l’apprentissage contrastif et l’augmentation latente pour généraliser en classification histologique à quelques exemples, plutôt que des agrégateurs sur caractéristiques figées.

   Résumé scientifique

   Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we facilitate the study of few-shot learning in histology images by setting up three cross-domain tasks that simulate real clinics problems. To enable label-efficient learning and better generalizability, we propose to incorporate contrastive learning (CL) with latent augmentation (LA) to build a few-shot system. CL learns useful representations without manual labels, while LA transfers semantic variations of the base dataset in an unsupervised way. These two c…

5. Apparenté Contexte plus large Pas pertinent

   Combining Insights From Multiple Large Language Models Improves Diagnostic Accuracy

   Gioele Barabucci, Victor Shia, Eugene Chu et al. · 2024 · Artificial Intelligence · cité 7 fois · Résumé IA disponible

   Cette étude agrège des réponses de modèles de langage pour améliorer les diagnostics sur vignettes cliniques, plutôt que des caractéristiques d’images histologiques.

   Résumé scientifique

   Background: Large language models (LLMs) such as OpenAI's GPT-4 or Google's PaLM 2 are proposed as viable diagnostic support tools or even spoken of as replacements for "curbside consults". However, even LLMs specifically trained on medical topics may lack sufficient diagnostic accuracy for real-life applications. Methods: Using collective intelligence methods and a dataset of 200 clinical vignettes of real-life cases, we assessed and compared the accuracy of differential diagnoses obtained by asking individual commercial LLMs (OpenAI GPT-4, Google PaLM 2, Cohere Command, Meta Llama 2) against the accuracy of differential diagnoses synthesized by aggregating responses from combinations of th…

6. Apparenté Contexte plus large Pas pertinent

   Is Dataset Quality Still a Concern in Diagnosis Using Large Foundation Model?

   Ziqin Lin, Heng Li, Zinan Li et al. · 2024 · Image and Video Processing · preprint, non relu par les pairs · cité 1 fois · Résumé IA disponible

   Cette étude examine l’effet de la qualité des données sur le diagnostic rétinien avec un modèle de fondation, tandis que cet article étudie la généralisation hospitalière en histologie.

   Résumé scientifique

   Recent advancements in pre-trained large foundation models (LFM) have yielded significant breakthroughs across various domains, including natural language processing and computer vision. These models have been particularly impactful in the domain of medical diagnostic tasks. With abundant unlabeled data, an LFM has been developed for fundus images using the Vision Transformer (VIT) and a self-supervised learning framework. This LFM has shown promising performance in fundus disease diagnosis across multiple datasets. On the other hand, deep learning models have long been challenged by dataset quality issues, such as image quality and dataset bias. To investigate the influence of data quality …

7. Apparenté Contexte plus large Pas pertinent

   Customizing General-Purpose Foundation Models for Medical Report Generation

   Bang Yang, Asif Raza, Yuexian Zou et al. · 2023 · Computer Vision and Pattern Recognition · preprint, non relu par les pairs · cité 15 fois · Résumé IA disponible

   Cette étude adapte des modèles de fondation visuels et linguistiques pour générer des comptes rendus médicaux, tandis que cet article classe des lames histologiques.

   Résumé scientifique

   Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical image-report pairs presents great challenges in the development of deep and large-scale neural networks capable of harnessing the potential artificial general intelligence power like large language models (LLMs). In this work, we propose customizing off-the-shelf general-purpose large-scale pre-trained models, i.e., foundation models (FMs), in computer vision and natural language processing with a specific focus on medical report generation. Specifically, follo…

8. Apparenté Autre approche du problème Pas pertinent

   StyPath: Style-Transfer Data Augmentation For Robust Histology Image Classification

   Pietro Antonio Cicalese, Aryan Mobiny, Pengyu Yuan et al. · 2020 · Computer Vision and Pattern Recognition · cité 19 fois · Résumé IA disponible

   StyPath utilise le transfert de style pour rendre robuste la classification histologique du rejet de greffe rénale, plutôt que l’alignement hospitalier de caractéristiques figées.

   Résumé scientifique

   The classification of Antibody Mediated Rejection (AMR) in kidney transplant remains challenging even for experienced nephropathologists; this is partly because histological tissue stain analysis is often characterized by low inter-observer agreement and poor reproducibility. One of the implicated causes for inter-observer disagreement is the variability of tissue stain quality between (and within) pathology labs, coupled with the gradual fading of archival sections. Variations in stain colors and intensities can make tissue evaluation difficult for pathologists, ultimately affecting their ability to describe relevant morphological features. Being able to accurately predict the AMR status ba…