Large-scale public lidar and satellite image data set for urban semantic labeling

Myron Brown; Hirsh Goldberg; Kevin Foster; Andrea Leichtman; Sean Wang; Shea Hagstrom; Marc Bosch; Scott Almes

doi:10.1117/12.2304403

10 May 2018 Large-scale public lidar and satellite image data set for urban semantic labeling

Myron Brown, Hirsh Goldberg, Kevin Foster, Andrea Leichtman, Sean Wang, Shea Hagstrom, Marc Bosch, Scott Almes

Proceedings Volume 10636, Laser Radar Technology and Applications XXIII; 106360P (2018) https://doi.org/10.1117/12.2304403
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

Automated semantic labeling of complex urban scenes in remotely sensed 2D and 3D data is one of the most challenging steps in producing realistic 3D scene models and maps. Recent large-scale public benchmark data sets and challenges for semantic labeling with 2D imagery have been instrumental in identifying state of the art methods and enabling new research. 3D data from lidar and multi-view stereo have also been shown to provide valuable additional information to enable improved semantic labeling accuracy. In this work, we describe the development of a new large-scale data set combining public lidar and multi-view satellite imagery with pixel-level truth for ground labels and instance-level truth for building labels. We demonstrate the use of this data set to evaluate methods for ground and building labeling tasks to establish performance expectations and identify areas for improvement. We also discuss initial steps toward further leveraging this data set to enable machine learning for more complex semantic and instance segmentation and 3D reconstruction tasks. All software developed to produce this public data set and to enable metric scoring are also released as open source code.

Conference Presentation

Citation Download Citation

Myron Brown, Hirsh Goldberg, Kevin Foster, Andrea Leichtman, Sean Wang, Shea Hagstrom, Marc Bosch, and Scott Almes "Large-scale public lidar and satellite image data set for urban semantic labeling", Proc. SPIE 10636, Laser Radar Technology and Applications XXIII, 106360P (10 May 2018); https://doi.org/10.1117/12.2304403

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available