Skip to main navigation Skip to search Skip to main content

FACMIC: Federated Adaptative CLIP Model for Medical Image Classification

  • Guilin University of Electronic Technology
  • École de technologie supérieure

Research output: Contribution to Book/Report types › Contribution to conference proceedings › peer-review

32 Citations (Scopus)

Abstract

Federated learning (FL) has emerged as a promising approach to medical image analysis that allows deep model training using decentralized data while ensuring data privacy. However, in the field of FL, communication cost plays a critical role in evaluating the performance of the model. Thus, transferring vision foundation models can be particularly challenging due to the significant resource costs involved. In this paper, we introduce a federated adaptive Contrastive Language Image Pretraining (CLIP) model designed for classification tasks. We employ a light-weight and efficient feature attention module for CLIP that selects suitable features for each client’s data. Additionally, we propose a domain adaptation technique to reduce differences in data distribution between clients. Experimental results on four publicly available datasets demonstrate the superior performance of FACMIC in dealing with real-world and multisource medical imaging data. Our codes are available at https://github.com/AIPMLab/FACMIC.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2024 - 27th International Conference, Proceedings
EditorsMarius George Linguraru, Qi Dou, Aasa Feragen, Stamatia Giannarou, Ben Glocker, Karim Lekadir, Julia A. Schnabel
PublisherSpringer Science and Business Media Deutschland GmbH
Pages531-541
Number of pages11
ISBN (Print)9783031723896
DOIs
Publication statusPublished - 2024
Event27th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2024 - Marrakesh, Morocco
Duration: 6 Oct 2024 → 10 Oct 2024

Publication series

NameLecture Notes in Computer Science
Volume15012 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference27th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2024
Country/TerritoryMorocco
CityMarrakesh
Period6/10/24 → 10/10/24

Keywords

  • Domain adaptation
  • Federated learning
  • Medical imaging

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'FACMIC: Federated Adaptative CLIP Model for Medical Image Classification'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this