Urban Architectural Style Recognition and Dataset Construction Method under Deep Learning of street View Images: A Case Study of Wuhan

The visual quality and spatial distribution of architectural styles represent a city’s image, influence inhabitants’ living conditions, and may have positive or negative social consequences which are critical to urban sensing and designing. Conventional methods of identifying architectural styles rely on human labor and are frequently time-consuming, inefficient, and subjective in judgment. These issues significantly affect the large-scale management of urban architectural styles. Fortunately, deep learning models have robust feature expression abilities for images and have achieved highly competitive results in object detection in recent years. They provide a new approach to supporting traditional architectural style recognition. Therefore, this paper summarizes 22 architectural styles in a study area which could be used to define and describe urban architectural styles in most Chinese urban areas. Then, this paper introduced a Faster-RCNN general framework of architectural style classification with a VGG-16 backbone network, which is the first machine learning approach to identifying architectural styles in Chinese cities. Finally, this paper introduces an approach to constructing an urban architectural style dataset by mapping the identified architectural style through continuous street view imagery and vector map data from a top-down building contour map. The experimental results show that the architectural style dataset created had a precision of 57.8%, a recall rate of 80.91%, and an F1 score of 0.634. This dataset can, to a certain extent, reflect the geographical distribution characteristics of a wide variety of urban architectural styles. The proposed approach could support urban design to improve a city’s image.