Yang, Michael Ying and Cao, Yanpeng and McDonald, John (2011) Fusion of camera images and laser scans for wide baseline 3D scene alignment in urban environments. ISPRS Journal of Photogrammetry and Remote Sensing, 66 (6 Supp). S52-S61. ISSN 0924-2716

Preview

Download (1MB) | Preview

Abstract

In this paper we address the problem of automatic laser scan registration in urban environments. This represents a challenging problem for two major reasons. First, two individual laser scans might be captured at significantly changed viewpoints (wide baseline) and have very little overlap. Second, man-made buildings usually contain many structures of similar appearances. This will result in considerable aliasing in the matching process. By sensor fusion of laser data with camera images, we propose a novel improvement to the existing 2D feature techniques to enable automatic 3D alignment between two widely separated scans. The key idea consists of extracting dominant planar structures from 3D point clouds and then utilizing the recovered 3D geometry to improve the performance of 2D image feature for wide baseline matching. The resulting feature descriptors become more robust to camera viewpoint changes after the procedure of viewpoint normalization. Moreover, the viewpoint normalized 2D features provide robust local feature information including patch scale and dominant orientation for effective repetitive structure matching in man-made environments. Comprehensive experimental evaluations with real data demonstrate the potential of the proposed method for automatic wide baseline 3D scan alignment in urban environments.

Item Type:	Article
Keywords:	Senor fusion; Terrestrial laser scan; Wide baseline alignment; Viewpoint invariant feature; Plane extraction; Feature extraction;
Academic Unit:	Faculty of Science and Engineering > Computer Science Faculty of Science and Engineering > Research Institutes > Hamilton Institute
Item ID:	12373
Identification Number:	https://doi.org/10.1016/j.isprsjprs.2011.09.004
Depositing User:	John McDonald
Date Deposited:	06 Feb 2020 10:51
Journal or Publication Title:	ISPRS Journal of Photogrammetry and Remote Sensing
Publisher:	Elsevier
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads