awesome-missing-modality-for-medical-images

📝 A comprehensive review of techniques to address the missing modality problem for medical images

If there are any related works I missed, please let me know! 😊 Feel free to contact me: han.liu@siemens-healthineers.com

Year	Paper	Code	Publication	Datasets	Unified	Reported results
2025	SimMLM: A Simple Framework for Multi-modal Learning with Missing Modality	✔️	ICCV	BraTS2018	✔️	RobustSeg, mmFormer,  ShaSpec, MoMKE
2025	IM-Fuse: A Mamba-based Fusion Block for Brain Tumor Segmentation with Incomplete Modalities	✔️	MICCAI	BraTS2023	✔️	IM-Fuse, U-HVED, RobustSeg, mmFormer, SFusion, ShaSpec, M3AE, and M3FeCon
2024	Feasibility and benefits of joint learning from MRI databases with different brain diseases and modalities for segmentation	✔️	MIDL	BraTS2016 MSSEG16 ATLAS TBI WMH ISLES	✔️	Unified > Separate, ModDrop > late fusion
2024	Missing as Masking: Arbitrary Cross-modal Feature Reconstruction for Incomplete Multimodal Brain Tumor Segmentation	❌	MICCAI	BraTS2018	✔️	> ModDrop++, mmFormer, M3AE
2024	PASSION: Towards Effective Incomplete Multi-Modal Medical Image Segmentation with Imbalanced Missing Rates	✔️	ACM MM	BraTS2020 MyoPS2020	✔️	> ModDrop, PMR, mmFormer, RFNet, M2FTrans
2024	Multi-Modal Modality-Masked Diffusion Network for Brain MRI Synthesis With Random Modality Missing	❌	TMI	IXI BraTS2019	✔️	> SynDiff, ReMIC
2023	SFusion: Self-attention based N-to-One Multimodal Fusion Block	✔️	MICCAI	SHL2019 BraTS2018 BraTS2020	✔️	> H-UVED, ACN, D2Net, GFF
2023	Scratch Each Other’s Back: Incomplete Multi-modal Brain Tumor Segmentation Via Category Aware Group Self-Support Learning	❌	ICCV	BraTS2015 BraTS2018 BraTS2020	✔️	> H-UVED, RobustSeg, RFNet, mmformer
2023	Query Re-Training for Modality-Gnostic Incomplete Multi-modal Brain Tumor Segmentation	❌	MICCAI workshop MMMI	BraTS2018 BraTS2020	✔️	> H-UVED, RobustSeg, RFNet, mmformer
2023	Modal-aware Visual Prompting for Incomplete Multi-modal Brain Tumor Segmentation	❌	ACM	BraTS2015 BraTS2018 BraTS2020	✔️	> HeMIS, H-UVED, RobustSeg, mmformer
2023	M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities	✔️	AAAI	BraTS2018 BraTS2020	✔️	> H-UVED, ACN, SMU-Net, RFNet
2023	Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling	✔️	CVPR	BraTS2018 BraTS2020	✔️	> HeMIS, H-UVED, RobustSeg, mmformer, ACN, KD-Net
2023	Enhancing Modality-Agnostic Representations via Meta-learning for Brain Tumor Segmentation	❌	ICCV	BraTS2018 BraTS2019 BraTS2020	✔️	> HeMIS, H-UVED, D2-Net, ACN, RFNet, mmformer
2023	M2FTrans: Modality-Masked Fusion Transformer for Incomplete Multi-Modality Brain Tumor Segmentation	✔️	JBHI	BraTS2018 BraTS2020	✔️	> HeMIS, H-UVED, RobustSeg, RFNet, mmformer, ACN, SMU-Net
2023	Prototype Knowledge Distillation for Medical Segmentation with Missing Modality	✔️	ICASSP	BraTS2018	❌	> H-UVED, KD-Net, PMKL
2023	MMCFormer: Missing Modality Compensation Transformer for Brain Tumor Segmentation	✔️	MIDL	BraTS2018	❌	> HeMIS, H-UVED, ACN, SMU
2022	D2-Net: Dual Disentanglement Network for Brain Tumor Segmentation with Missing Modalities	✔️	TMI	BraTS2018	✔️	> HeMIS, H-UVED, KD-net, ACN, RobustSeg
2022	mmformer: Multimodal medical transformer for incomplete multimodal learning of brain tumor segmentation	✔️	MICCAI	BraTS2018	✔️	> HeMIS, H-UVED; < ACN
2022	ModDrop++: A Dynamic Filter Network with Intra-subject Co-training for Multiple Sclerosis Lesion Segmentation with Missing Modalities	✔️	MICCAI	ISBI UMCL	✔️	> modality dropout
2022	SMU-Net: Style matching U-Net for brain tumor segmentation with missing modalities	✔️	MIDL	BraTS2018	❌	> HeMIS, H-UVED, ACN
2021	Learning with Privileged Multimodal Knowledge for Unimodal Segmentation	✔️	TMI	MyoPS BraTS2018	❌	> RobustSeg, SynthesisNet, KD-Net
2021	ACN: Adversarial Co-training Network for Brain Tumor Segmentation with Missing Modalities	✔️	MICCAI	BraTS2018	❌	> HeMIS, H-UVED, KD-Net
2021	RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor Segmentation	✔️	ICCV	BraTS2015 BraTS2018 BraTS2020	✔️	> HeMIS, H-UVED, RobustSeg
2019	Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation	✔️	MICCAI	BraTS2018	✔️	> HeMIS, H-HeMIS; < Ind. model
2019	Robust Multimodal Brain Tumor Segmentation via Feature Disentanglement and Gated Fusion	✔️	MICCAI	BraTS2015	✔️	> HeMIS, imputation MLP
2016	HeMIS: Hetero-Modal Image Segmentation	❌	MICCAI	MSGC BraTS2013	✔️	> mean-filling, imputation MLP