论文标题
PSIGAN:基于未配对的跨模式适应的MRI分割的联合概率分割和图像分布匹配
PSIGAN: Joint probabilistic segmentation and image distribution matching for unpaired cross-modality adaptation based MRI segmentation
论文作者
论文摘要
我们开发了一种新的关节概率分割和图像分布匹配生成对抗网络(PSIGAN),用于无监督的域适应性(UDA)和磁共振(MRI)图像的多器官分割。我们的UDA方法使用新结构鉴别器将图像及其分割之间的共同依赖性建模为关节概率分布。结构判别器通过将生成的伪MRI与同时受过训练的分割子网络产生的概率分割相结合来计算关注的对抗损失的结构。使用发电机子网络产生的伪MRI训练分割子网络。这导致了对发电机和分割子网络的周期性优化,这些子网络是端到端网络的一部分。对多种最新方法进行了广泛的实验和比较,对四个不同的MRI序列进行了257次扫描,以产生多器官和肿瘤分割。 The experiments included, (a) 20 T1-weighted (T1w) in-phase mdixon and (b) 20 T2-weighted (T2w) abdominal MRI for segmenting liver, spleen, left and right kidneys, (c) 162 T2-weighted fat suppressed head and neck MRI (T2wFS) for parotid gland segmentation, and (d) 75 T2w MRI for lung肿瘤分割。我们的方法在腹部器官的T1W上达到了T1W的总平均DSC为0.87,T2W的总平均DSC为0.90,腮腺的T2WF为0.82,肺部肿瘤的T2W MRI为0.77。
We developed a new joint probabilistic segmentation and image distribution matching generative adversarial network (PSIGAN) for unsupervised domain adaptation (UDA) and multi-organ segmentation from magnetic resonance (MRI) images. Our UDA approach models the co-dependency between images and their segmentation as a joint probability distribution using a new structure discriminator. The structure discriminator computes structure of interest focused adversarial loss by combining the generated pseudo MRI with probabilistic segmentations produced by a simultaneously trained segmentation sub-network. The segmentation sub-network is trained using the pseudo MRI produced by the generator sub-network. This leads to a cyclical optimization of both the generator and segmentation sub-networks that are jointly trained as part of an end-to-end network. Extensive experiments and comparisons against multiple state-of-the-art methods were done on four different MRI sequences totalling 257 scans for generating multi-organ and tumor segmentation. The experiments included, (a) 20 T1-weighted (T1w) in-phase mdixon and (b) 20 T2-weighted (T2w) abdominal MRI for segmenting liver, spleen, left and right kidneys, (c) 162 T2-weighted fat suppressed head and neck MRI (T2wFS) for parotid gland segmentation, and (d) 75 T2w MRI for lung tumor segmentation. Our method achieved an overall average DSC of 0.87 on T1w and 0.90 on T2w for the abdominal organs, 0.82 on T2wFS for the parotid glands, and 0.77 on T2w MRI for lung tumors.