Deep evidential fusion with uncertainty quantification and reliability learning for multimodal medical image segmentation - Connaissances, Incertitudes et Données
Article Dans Une Revue Information Fusion Année : 2025

Deep evidential fusion with uncertainty quantification and reliability learning for multimodal medical image segmentation

Résumé

Single-modality medical images generally do not contain enough information to reach an accurate and reliable diagnosis. For this reason, physicians commonly rely on multimodal medical images for comprehensive diagnostic assessments. This study introduces a deep evidential fusion framework designed for segmenting multimodal medical images, leveraging the Dempster-Shafer theory of evidence in conjunction with deep neural networks. In this framework, features are first extracted from each imaging modality using a deep neural network, and features are mapped to Dempster-Shafer mass functions that describe the evidence of each modality at each voxel. The mass functions are then corrected by the contextual discounting operation, using learned coefficients quantifying the reliability of each source of information relative to each class. The discounted evidence from each modality is then combined using Dempster's rule of combination. Experiments were carried out on a PET-CT dataset for lymphoma segmentation and a multi-MRI dataset for brain tumor segmentation. The results demonstrate the ability of the proposed fusion scheme to quantify segmentation uncertainty and improve segmentation accuracy. Moreover, the learned reliability coefficients provide some insight into the contribution of each modality to the segmentation process.
Fichier principal
Vignette du fichier
deep_fusion_v3.pdf (2.85 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04681852 , version 1 (30-08-2024)

Identifiants

Citer

Ling Huang, Su Ruan, Pierre Decazes, Thierry Denœux. Deep evidential fusion with uncertainty quantification and reliability learning for multimodal medical image segmentation. Information Fusion, 2025, 113, pp.102648. ⟨10.1016/j.inffus.2024.102648⟩. ⟨hal-04681852⟩
77 Consultations
123 Téléchargements

Altmetric

Partager

More