← Back
CAADRIA 2024 1st Author · Full Paper Spatial AI ↗ Paper

UrbanSight: Application of Digital Twin to Augmented Reality

Tzu-Hsin Hsieh, Tay Sheng Jeng

UrbanSight MR environment

Abstract

UrbanSight is a collaborative mixed-reality platform that connects a live digital twin with physical architectural models through HoloLens 2. Multiple users share a synchronized holographic workspace, interacting with real-time BIM data, geospatial overlays, and 3D urban models co-located in the same physical space.

The system was awarded the Young CAADRIA Award 2024, recognizing its contribution to integrating digital twin technology with human-centered mixed-reality interfaces for architectural design review.

Key Contributions

  • Multi-user shared holographic space using Azure Spatial Anchors for world-locked alignment across HoloLens 2 devices.
  • Real-time BIM integration: IFC data streamed and rendered as interactive 3D holograms at 1:1 and reduced scales.
  • Gesture-based UI for layer toggling, cross-section cutting, and annotation directly in AR space.
  • Received the Young CAADRIA Award at CAADRIA 2024, Singapore.

Technologies

HoloLens 2MRTK 3Unity / C# Azure Spatial AnchorsBIM / IFCDigital Twin Mixed RealityCAADRIA 2024

BibTeX

@inproceedings{hsieh2024urbansight,
  title={URBANSIGHT: Application of Digital Twin to Augmented Reality},
  author={Hsieh, Tzu Hsin and Jeng, Tay Sheng},
  booktitle={29th International Conference on Computer-Aided Architectural Design Research in Asia, CAADRIA 2024},
  pages={271--280},
  year={2024},
  organization={The Association for Computer-Aided Architectural Design Research in Asia}
}