ASCE Construction Research Congress
Agentic AI for Autonomous Construction Issue Detection
A Multimodal Framework Using Model Context Protocol
Quality management remains a persistent challenge in the construction industry, with rework accounting for significant cost growth and schedule delays. While digital inspection technologies have improved data capture, defect identification still relies on manual, error-prone processes. This paper introduces an agentic AI framework, implemented through Model Context Protocol (MCP), for autonomous construction quality management. The framework integrates retrieval-augmented reasoning over specifications and drawings, multimodal site imagery, and structured issue generation through orchestrated large language model (LLM) agents. A case study on an office renovation project demonstrates the feasibility of the approach. The system accurately retrieved construction information from specifications, achieving a mean cosine similarity of 0.82 on queries compared to manual responses and successfully identified 9 of 10 documented quality issues, including design misalignments and field non-conformances. These findings provide empirical evidence that agentic AI can extend beyond descriptive reporting toward actionable quality management. The contributions are twofold: (i) a modular MCP-based architecture for orchestrating construction AI agents, and (ii) validation through deployment in a live project environment. While evaluation is limited in scope, results highlight both the promise and challenges of integrating agentic AI into daily workflows, paving the way for larger-scale studies and future digital twin integration.
Download publicationAssociated Researchers
Simge Girgin
Stanford
Parastoo Varshosaz
WZMH Architects
Related Publications
2025
A Contactless Multi-Modal Sensing Approach for Material Assessment and Recovery in Building DeconstructionThis research enables contactless assessment of in-situ buildings to…
2025
Integrated Fiber Forms: Functionally Integrated Slab Systems through Additive Manufacturing and Natural Fiber ReinforcementCombining 3D-printed formwork from upcycled wood to deliver a…
2025
Effect of Interface Orientation in Laser Powder Bed Fusion of IN718/GRCop-42 Bimetallic Parts for AerospaceThis study explores practical design rules for reliable graded parts…
2025
Charting an AI-Enabled Future of ConstructionExplores the unprecedented transformation of Canada’s construction…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us