Changyu Du

Lehrstuhl für Computing in Civil and Building Engineering, TU München

Matchmaking-Informationen

Teilnahme

2.2.1 Agentic AI Meets Geodata and BIM (presented by Runder Tisch GIS e.V.)

BIMgent: Generating Building Models via Computer-use Agents

Mittwoch, 16. Sept. 2026
10:10 - 10:30 | Europe/Berlin
INTERGEO Conference | Room C 54

Meine Veranstaltungen (1)

Veranstaltung
2.2.1 Agentic AI Meets Geodata and BIM (presented by Runder Tisch GIS e.V.)
Mittwoch, 16. Sept. 2026
10:10 - 10:30 | Europe/Berlin
Vortrag // Presentation
INTERGEO Conference | Room C 54
Englisch

BIMgent: Generating Building Models via Computer-use Agents

Building Information Modeling (BIM) authoring in the Architecture, Engineering, and Construction (AEC) sector entails navigating complex professional software, demanding significant manual effort and domain expertise. While current automation approaches rely heavily on rigid Application Programming Interfaces (APIs), they often detach agents from human-centric visual workflows, with API-specific implementations further limiting their generalizability across software platforms. In this work, we introduce BIMgent, a multimodal LLM-based agentic framework designed to perform autonomous BIM authoring directly via Graphical User Interface (GUI) interactions. To mitigate the challenges of high visual noise and long-horizon dependencies inherent in BIM authoring software, BIMgent incorporates a hierarchical planning mechanism guided by software documentation and employs dynamic GUI grounding to precisely navigate complex user interfaces. We evaluate our framework on a benchmark derived from real-world residential building designs. Experimental results demonstrate that BIMgent achieves a 77.8\% end-to-end success rate in correctly generating semantically rich BIM models from input floorplans, significantly outperforming the leading generalist computer-use models, including Claude-Sonnet-4.5 (2.2\%) and GPT-5.4 (11.1\%). By bridging the gap between abstract design inputs and concrete modeling actions without API constraints, BIMgent presents a viable and generalizable path toward autonomous architectural modeling assistants. 

KI // AI
BIM / Scan2BIM / InfraBIM
Sprecher*in (1)
Changyu Du
Lehrstuhl für Computing in Civil and Building Engineering, TU München
Moderator*in (1)
Jörg Blankenbach
Leiter Geodätisches Institut, RWTH Aachen University