Novel application of the attention mechanism on medical image harmonization

Xing Yao; Ange Lou; Hao Li; Dewei Hu; Daiwei Lu; Han Liu; Jiacheng Wang; Zachary Stoebner; Hans Johnson; Jeff D. Long; Jane S. Paulsen; Ipek Oguz

doi:10.1117/12.2654392

3 April 2023 Novel application of the attention mechanism on medical image harmonization

Xing Yao, Ange Lou, Hao Li, Dewei Hu, Daiwei Lu, Han Liu, Jiacheng Wang, Zachary Stoebner, Hans Johnson, Jeff D. Long, Jane S. Paulsen, Ipek Oguz

Author Affiliations +

Proceedings Volume 12464, Medical Imaging 2023: Image Processing; 124640Y (2023) https://doi.org/10.1117/12.2654392
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

Medical image harmonization aims to transform the image ‘style’ among heterogeneous datasets while preserving the anatomical content. It enables data-sensitive learning-based approaches to fully leverage the data power of large multi-site datasets with different image acquisitions. Recently, the attention mechanism has achieved excellent performance on the image-to-image (I2I) translation of natural images. In this work, we further explore the potential of leveraging the attention mechanism to improve the performance of medical image harmonization. Here, we introduce two attention-based frameworks with outstanding performance in the natural I2I scenario in the context of cross-scanner MRI harmonization for the first time. We compare them with the existing commonly used harmonization frameworks by evaluating their ability to enhance the performance of the downstream subcortical segmentation task on T1-weighted (T1w) MRI datasets from 1.5T vs. 3T scanners. Both qualitative and quantitative results prove that the attention mechanism contributes to a noticeable improvement in harmonization ability.

Conference Presentation

Citation Download Citation

Xing Yao, Ange Lou, Hao Li, Dewei Hu, Daiwei Lu, Han Liu, Jiacheng Wang, Zachary Stoebner, Hans Johnson, Jeff D. Long, Jane S. Paulsen, and Ipek Oguz "Novel application of the attention mechanism on medical image harmonization", Proc. SPIE 12464, Medical Imaging 2023: Image Processing, 124640Y (3 April 2023); https://doi.org/10.1117/12.2654392

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available