论文标题
结构上意识到双向未配对的图像到CT和MR之间的图像翻译
Structurally aware bidirectional unpaired image to image translation between CT and MR
论文作者
论文摘要
磁共振(MR)成像和计算机断层扫描(CT)是经常用于手术计划和分析的主要诊断成像方式。医学成像的总体问题是,采集过程非常昂贵且耗时。诸如生成对抗网络(GAN)之类的深度学习技术可以帮助我们利用图像的可能性来在多个成像方式之间进行图像翻译,从而有助于节省时间和成本。这些技术将通过MRI信息的反馈来帮助根据CT进行手术计划。虽然先前的研究表明,从MR到CT的成对和未配对的图像合成,但从CT到MR的图像合成仍然是一个挑战,因为它涉及添加额外的组织信息。在本手稿中,我们实施了两种不同的生成对抗网络变体,利用了骨盆数据集上CT和MR图像模态之间的循环一致性和结构相似性,从而促进了这些图像模态之间内容和样式的双向交换。拟议的gans通过不同的机制转化了输入医学图像,因此产生的图像不仅看起来很现实,而且在各种比较指标中表现良好,并且这些图像也已与放射科医生进行了交叉验证。放射科医生的验证表明,生成的MR和CT图像的略有变化可能与它们的真实对应物不同,但可以用于医疗目的。
Magnetic Resonance (MR) Imaging and Computed Tomography (CT) are the primary diagnostic imaging modalities quite frequently used for surgical planning and analysis. A general problem with medical imaging is that the acquisition process is quite expensive and time-consuming. Deep learning techniques like generative adversarial networks (GANs) can help us to leverage the possibility of an image to image translation between multiple imaging modalities, which in turn helps in saving time and cost. These techniques will help to conduct surgical planning under CT with the feedback of MRI information. While previous studies have shown paired and unpaired image synthesis from MR to CT, image synthesis from CT to MR still remains a challenge, since it involves the addition of extra tissue information. In this manuscript, we have implemented two different variations of Generative Adversarial Networks exploiting the cycling consistency and structural similarity between both CT and MR image modalities on a pelvis dataset, thus facilitating a bidirectional exchange of content and style between these image modalities. The proposed GANs translate the input medical images by different mechanisms, and hence generated images not only appears realistic but also performs well across various comparison metrics, and these images have also been cross verified with a radiologist. The radiologist verification has shown that slight variations in generated MR and CT images may not be exactly the same as their true counterpart but it can be used for medical purposes.