Customized Segment Anything Model for Medical Image Segmentation

AI-generated keywords: Customized Segment Anything Model SAMed Medical Image Segmentation Low-rank-based fine-tuning Synapse multi-organ segmentation dataset

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • SAMed is a novel solution for medical image segmentation based on the Segment Anything Model (SAM)
  • SAMed utilizes a low-rank-based fine-tuning strategy and the AdamW optimizer for convergence and lower loss
  • SAMed achieves impressive results with an 81.88 Dice Similarity Coefficient and 20.64 Hausdorff Distance on the Synapse multi-organ segmentation dataset
  • SAMed's ability to perform semantic segmentation on medical images sets it apart from previous methods
  • The deployment cost and storage requirements of SAMed are minimal due to updating only a small fraction of parameters during training
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Kaidong Zhang, Dong Liu

Technical report, 14 pages

Abstract: We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of customizing large-scale models for medical image segmentation. SAMed applies the low-rank-based (LoRA) finetuning strategy to the SAM image encoder and finetunes it together with the prompt encoder and the mask decoder on labeled medical image segmentation datasets. We also observe the warmup finetuning strategy and the AdamW optimizer lead SAMed to successful convergence and lower loss. Different from SAM, SAMed could perform semantic segmentation on medical images. Our trained SAMed model achieves 81.88 DSC and 20.64 HD on the Synapse multi-organ segmentation dataset, which is on par with the state-of-the-art methods. We conduct extensive experiments to validate the effectiveness of our design. Since SAMed only updates a small fraction of the SAM parameters, its deployment cost and storage cost are quite marginal in practical usage. The code of SAMed is available at https://github.com/hitachinsk/SAMed.

Submitted to arXiv on 26 Apr. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2304.13785v2

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In their technical report titled "Customized Segment Anything Model for Medical Image Segmentation," authors Kaidong Zhang and Dong Liu introduce SAMed, a novel solution for medical image segmentation. Unlike previous methods, SAMed is based on the Segment Anything Model (SAM), a large-scale image segmentation model, aiming to explore the customization of such models for medical image segmentation. The approach involves applying a low-rank-based (LoRA) fine-tuning strategy to the SAM image encoder, along with the prompt encoder and mask decoder, on labeled medical image segmentation datasets. By incorporating warmup fine-tuning and utilizing the AdamW optimizer, SAMed demonstrates successful convergence and lower loss compared to its predecessors. One key distinction of SAMed is its ability to perform semantic segmentation on medical images. The authors report that their trained SAMed model achieves impressive results with an 81.88 Dice Similarity Coefficient (DSC) and 20.64 Hausdorff Distance (HD) on the Synapse multi-organ segmentation dataset, putting it on par with state-of-the-art methods in the field. Extensive experiments were conducted to validate the effectiveness of this design. Furthermore, SAMed's deployment cost and storage requirements are minimal in practical usage due to only updating a small fraction of the SAM parameters during training. The code for implementing SAMed is openly available at https://github.com/hitachinsk/SAMed, enabling further exploration and application of this innovative approach in medical image analysis.
Created on 16 Mar. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.