Visual place recognition based on multilevel descriptors for the visually impaired people

Yicheng Fang; Kaiwei Wang; Ruiqi Cheng; Kailun Yang; Jian Bai

doi:10.1117/12.2532524

17 October 2019 Visual place recognition based on multilevel descriptors for the visually impaired people

Yicheng Fang, Kaiwei Wang, Ruiqi Cheng, Kailun Yang, Jian Bai

Proceedings Volume 11158, Target and Background Signatures V; 1115808 (2019) https://doi.org/10.1117/12.2532524
Event: SPIE Security + Defence, 2019, Strasbourg, France

Abstract

The Visually Impaired People (VIP) have the difficulty in perceiving the accurate localization in their daily life. Developing an efficient algorithm to address the localization issues of the VIP is crucial. Visual Place Recognition (VPR) refers to using the image retrieval algorithms to determine the location of a query image in the database, which is promising to help the VIP solve their localization problems. However, the accuracy of VPR is directly affected by the changes of scene appearances such as illumination, seasons and viewpoints. Therefore, finding a method to extract robust image descriptors under the changes of scene appearance is one of the most critical tasks in current VPR research. In this paper, we propose a VPR approach to assist the localization and navigation of visually impaired pedestrians. The core of our proposal is a combination of multi-level descriptors by using appropriate descriptors: the whole image, local regions and key-points, aimed to enhance the robustness of VPR. The matching procedure between query images and database images includes three steps. Firstly, we obtain the Convolutional Neural Networks (CNN) features of the whole images from a pre-trained GoogLeNet, and the Euclidean distances between the query images and the database images are computed to determine the top 10 good matches. Secondly, local salient regions are detected from the top-10 best-matched images with Non-Maximum Suppression (NMS) to control the number of bounding boxes. Thirdly, we detect the SIFT key-points and extract the geodesc descriptors of the key-points, from the local salient region, and determine the top 1 among the top 10 good matches. In order to verify our approach, a comprehensive set of experiments has been conducted on dataset with challenging environmental changes, such as the GardensPointWalking dataset.

Conference Presentation

Citation Download Citation

Yicheng Fang, Kaiwei Wang, Ruiqi Cheng, Kailun Yang, and Jian Bai "Visual place recognition based on multilevel descriptors for the visually impaired people", Proc. SPIE 11158, Target and Background Signatures V, 1115808 (17 October 2019); https://doi.org/10.1117/12.2532524

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available