Deep learning-based volumetric image generation from projection imaging for prostate radiotherapy

Xianjin Dai; Yang Lei; Zhen Tian; Tonghe Wang; Tian Liu; Walter J. Curran; Xiaofeng Yang

doi:10.1117/12.2581053

15 February 2021 Deep learning-based volumetric image generation from projection imaging for prostate radiotherapy

Xianjin Dai, Yang Lei, Zhen Tian, Tonghe Wang, Tian Liu, Walter J. Curran, Xiaofeng Yang

Proceedings Volume 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling; 115981R (2021) https://doi.org/10.1117/12.2581053
Event: SPIE Medical Imaging, 2021, Online Only

Conference Poster

Abstract

Due to the inter-fraction variation of anatomy, it is highly desired to provide fast and low-dose volumetric imaging during prostate radiation therapy treatment for patient setup and daily treatment dose estimation. In this study, we propose a novel generative adversarial network integrated with perceptual supervision to derive 3D volumetric images from two orthogonal 2D projections. Our proposed network, named TransNet, consists of three modules, i.e., encoding, transformation and decoding modules. Rather than only using image distance loss between the generated 3D images and the ground truth 3D CT images to supervise the network, adversarial loss is used to improve the realism of generated 3D images. We conducted a study on 20 patient cases, who had received prostate radiotherapy in our institution, and evaluated the efficacy and consistency of our method for two orthogonal projection angles, i.e., 0° and 90°. For each 3D CT image, we simulated its 2D projections at these two angles. The TransNet takes the two angles as input and output the 3D CT. The mean absolute error (MAE), peak signal-to-noise ratio (PSNR) and structural similarity index metric (SSIM) achieved by our method are 117.5±15.3HU, 22.7±3.8dB and 0.904±0.27, respectively. These results demonstrate the feasibility and efficacy of our 2D-to-3D method for prostate cancer patients, which provides a potential solution for fast on-board volumetric imaging for patient setup and adaptive radiation therapy.

Citation Download Citation

Xianjin Dai, Yang Lei, Zhen Tian, Tonghe Wang, Tian Liu, Walter J. Curran, and Xiaofeng Yang "Deep learning-based volumetric image generation from projection imaging for prostate radiotherapy", Proc. SPIE 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling, 115981R (15 February 2021); https://doi.org/10.1117/12.2581053

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available