IEEE Symposium on Visual Languages and Human-Centric Computing
Curompt
A Spatially Situated Interface for Generative AI in 3D Design Software
Generative AI tools are increasingly being integrated into various workflows. Many powerful AI systems, such as ChatGPT, Gemini, and Grok, are accessed through simple chat interfaces. While these language-based interactions may seem intuitive and futuristic, they also bear a resemblance to early computer command lines. With our prototype system, Curompt (combined cursor+prompt), we explore how to integrate conversational interaction powered by generative AI into familiar graphical interfaces with direct manipulation. We focused on the 3D environment, where relying on language-based interactions alone proves to be challenging.
Download publicationRelated Publications
2026
PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud ComputingointAloud is a suite of novel AI-driven pointer-centric interactions…
2026
FeedQUAC: Quick Unobtrusive AI-Generated CommentaryFeedQUAC is an ambient design companion tool that supports designers…
2026
Protosampling: Enabling Free-Form Convergence of Sampling and Prototyping through Canvas-Driven Visual AI GenerationAtelier is a canvas-based system for thinking and making activities…
2024
AQuA: Automated Question-Answering in Software Tutorial Videos with Visual AnchorsAn automated approach leveraging a large language model augmented with…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us