Synthesize CT from paired MRI of the same patient with patch-based generative adversarial network

Yan Li; Jun Wei; Zhenyu Qi; Ying Sun; Yao Lu

doi:10.1117/12.2551285

16 March 2020 Synthesize CT from paired MRI of the same patient with patch-based generative adversarial network

Yan Li, Jun Wei, Zhenyu Qi, Ying Sun, Yao Lu

Proceedings Volume 11314, Medical Imaging 2020: Computer-Aided Diagnosis; 113143W (2020) https://doi.org/10.1117/12.2551285
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

In current clinical practice, paired computed tomography (CT) providing electron density information for dose calculation and magnetic resonance imaging (MRI) providing molecular information for GTV delineation are acquired during radiation therapy planning of head cancer. Aimed to reduce repeatedly scanning procedures, we developed a patch-based deep learning approach to generate synthetic CT from paired MRI of the same patient. In this approach, 2D slices of MRI and CT would be divided into several overlap patches and sent to cycle-consistent generative adversarial network (CycleGAN) for training with a combination of multiple loss functions. For comparison, we also applied CycleGAN and pix2pix model using whole 2D slices as input. With IRB approval, a total number of 2542 paired MRI and CT images were collected in the experiment. Mean absolute error (MAE) and peak signal to noise ratio (PSNR) were used as evaluation metrics. The result showed that our proposed model performed best on both whole brain areas. We also provided the difference map between synthetic and real CT to give a visual evaluation of our proposed model.

Citation Download Citation

Yan Li, Jun Wei, Zhenyu Qi, Ying Sun, and Yao Lu "Synthesize CT from paired MRI of the same patient with patch-based generative adversarial network", Proc. SPIE 11314, Medical Imaging 2020: Computer-Aided Diagnosis, 113143W (16 March 2020); https://doi.org/10.1117/12.2551285

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available