Paper: Heterogeneous graph neural networks for building attribute prediction from hierarchical urban features and cross-view imagery

Data on building properties are essential for a variety of urban applications, yet such information remains scarce in many parts of the world. Recent efforts have leveraged instruments such as machine learning (ML), computer vision (CV), and graph neural networks (GNNs) to assess these properties at scale by leveraging urban features or visual information. However, extracting holistic representations to infer building attributes from multi-modal data across multiple spatial scales and vertical building characteristics remains a significant challenge.

To bridge this gap, we present a innovative framework, that captures both hierarchical urban features and cross-view visual information through a heterogeneous graph. First, we construct a heterogeneous graph that incorporates multi-dimensional urban elements --- buildings, streets, intersections, and urban plots --- to comprehensively represent multi-scale geospatial features.

Second, we automatically crop images of individual buildings from both very high-resolution satellite and street-level imagery, and introduce feature propagation on semantic similarity graphs to supplement missing facade information. Third, feature fusion is applied to integrate both morphological and visual features, with holistic representations generated for building attribute prediction.

@article{liang2026heterognn,
title = {Heterogeneous Graph Neural Networks for Building Attribute Prediction from Hierarchical Urban Features and Cross-View Imagery},
author = {Liang, Xiucheng and Yap, Winston and Biljecki, Filip},
year = 2026,
journal = {ISPRS Journal of Photogrammetry and Remote Sensing},
volume = {234},
pages = {185--204},
issn = {0924-2716},
}