1. Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph
- Author
-
Gautam S. Thakur, Debraj De, Junchuan Fan, and Rutuja Gurav
- Subjects
Structure (mathematical logic) ,Information retrieval ,Geospatial analysis ,Word embedding ,Nearest neighbor graph ,Point of interest ,Computer science ,Information system ,Graph (abstract data type) ,Conflation ,computer.software_genre ,computer - Abstract
With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.
- Published
- 2021