1. Facade Segmentation from Oblique UAV Imagery
- Author
-
Milena Mönks, Peter Reinartz, Xiangyu Zhuo, and Thomas Esch
- Subjects
010504 meteorology & atmospheric sciences ,Exploit ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,UAV imagery ,ComputerApplications_COMPUTERSINOTHERSYSTEMS ,02 engineering and technology ,01 natural sciences ,Convolutional neural network ,0202 electrical engineering, electronic engineering, information engineering ,Leverage (statistics) ,Segmentation ,Computer vision ,Dynamik der Landoberfläche ,Aerial image ,0105 earth and related environmental sciences ,Photogrammetrie und Bildanalyse ,fully convolutional neural network (FCN) ,building information model ,business.industry ,Oblique case ,deep learning ,Semantic segmentation ,Building information modeling ,020201 artificial intelligence & image processing ,Facade ,Artificial intelligence ,business - Abstract
Building semantic segmentation is a crucial task for building information modeling (BIM). Current research generally exploits terrestrial image data, which provides only limited view of a building. By contrast, oblique imagery acquired by unmanned aerial vehicle (UAV) can provide richer information of both the building and its surroundings at a larger scale. In this paper, we present a novel pipeline for building semantic segmentation from oblique UAV images using a fully convolutional neural network (FCN). To cope with the lack of UAV image annotations at facade level, we leverage existing ground-view facades databases to simulate various aerial-view images based on estimated homography, yielding abundant synthetic aerial image annotations as training data. The FCN is trained end-to-end and tested on full-tile UAV images. Experiments demonstrate that the incorporation of simulated views can significantly boost the prediction accuracy of the network on UAV images and achieve reasonable segmentation performance.
- Published
- 2019