Mask-guided two-stream attention network with modality alignment for infrared-visible  person re-identification

Yijie Gou; Wenfeng Zhang; Xiaohong Lan; Yi Liu; Xiaoyun Lan

doi:10.1117/12.3004684

9 October 2023 Mask-guided two-stream attention network with modality alignment for infrared-visible person re-identification

Yijie Gou, Wenfeng Zhang, Xiaohong Lan, Yi Liu, Xiaoyun Lan

Author Affiliations +

Proceedings Volume 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023); 127911R (2023) https://doi.org/10.1117/12.3004684
Event: Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 2023, Qingdao, SD, China

Abstract

In the existing person re-identification research, most of the studies are based on the person re-identification of visible light images, and the illumination conditions can affect the experimental results. Therefore, cross-modal person re-identification research has emerged, and the most commonly used method is visible-infrared person re-identification. Due to different cameras, different camera angles, different scenes, and other factors, cross-modal person re-identification faces great challenges of cross-modal differences and intra-class variations. Therefore, Mask-guided Two-stream Attention Network (MTAN) with modality alignment for infrared-visible person re-identification is proposed in this paper. First, the mask-guided two-stream feature extraction network is proposed to extract shape-aware modality features. Then, the modality alignment module is designed to eliminate cross-modal feature distribution bias. Overall, the proposed method combines the mask-guided two-stream feature extraction network, modality alignment module and the loss functions, to effectively extract modality-aware distinguishable features and reduce cross-modal distribution bias.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yijie Gou, Wenfeng Zhang, Xiaohong Lan, Yi Liu, and Xiaoyun Lan "Mask-guided two-stream attention network with modality alignment for infrared-visible person re-identification", Proc. SPIE 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 127911R (9 October 2023); https://doi.org/10.1117/12.3004684

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Infrared imaging

Infrared radiation

Feature extraction

Visible radiation

Semantics

RGB color model

Infrared cameras

Show All Keywords

Keywords/Phrases

Search In:

Publication Years