Paper: Decoding characteristics of building facades using street view imagery and vision-language model

Paper: Decoding characteristics of building facades using street view imagery and vision-language model

Abstract

Acquiring and analysing the characteristics of buildings in cities has long been of interest, while comprehensive evaluation at scale remains challenging. This study investigates a novel approach to encoding the characteristics of building facades in urban areas by leveraging street view imagery (SVI) and vision-language models. Among the first, we integrated large language models and natural language understanding to analyse 48,752 building images in Hong Kong, identifying eight building clusters aligned to geometric footprints city-wide. Our findings highlight the effectiveness of SVI-based analyses in capturing urban spatial and semantic details, providing scalable insights that bridge visual and linguistic domains for a deeper understanding of the built environment.

Related Publications

Decoding characteristics of building facades using street view imagery and vision-language model

Xiucheng Liang, Sifan Cheng, Filip Biljecki

Presented at the 19th International Conference on Computational Urban Planning and Urban Management, 2025

PDF

Related Posts

Paper: Revealing spatio-temporal evolution of urban visual environments with street view imagery

Paper: Revealing spatio-temporal evolution of urban visual environments with street view imagery

This study presents an embedding-driven clustering approach that combines physical and perceptual attributes to analyze the spatial structure and spatio-temporal evolution of urban visual environments. Using Singapore as a case study, it leverages street view imagery and graph neural networks to classify streetscapes into six clusters, revealing changes over the past decade. The findings provide insights into urban visual dynamics, supporting planning and landscape improvement.

Read More
Paper: Evaluating human perception of building exteriors using street view imagery

Paper: Evaluating human perception of building exteriors using street view imagery

This study explores how building appearances shape urban perception, using machine learning and survey data to analyze human responses to over 250,000 building images from Singapore, San Francisco, and Amsterdam. Findings reveal how architectural styles influence streetscape perceptions, offering insights for architects and city planners.

Read More
Talk: Climate Change AI Discussion Seminar: Multimodal AI Approaches for Urban Microclimate Prediction and Building Analysis

Talk: Climate Change AI Discussion Seminar: Multimodal AI Approaches for Urban Microclimate Prediction and Building Analysis

Attended the October event in CCAI's Discussion Seminar Series. I presented my research on *Evaluating human perception of building exteriors using street view imagery* together with my colleagues Kunihiko Fujiwara and Binyu Lei. The presentation was followed by an interactive discussion in breakout rooms focused on translating this data into meaningful insights.

Read More