Publication | ACM UIST 2023
WorldSmith
Iterative and Expressive Prompting for World Building with a Generative AI
Abstract
WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI
Hai Dang, Frederik Brudy, George Fitzmaurice, Fraser Anderson
ACM UIST 2023
Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image generation systems to enable users iteratively visualize and modify elements of their fictional world using a combination of text input, sketching, and region-based filling. WorldSmith enables novice world builders to quickly visualize a fictional world with layered edits and hierarchical compositions. Through a formative study (4 participants) and first-use study (13 participants) we demonstrate that WorldSmith offers more expressive interactions with prompt-based models. With this work, we explore how creatives can be empowered to leverage prompt-based generative AI as a tool in their creative process, beyond current “click-once” prompting UI paradigms.
Download publicationRelated Resources
2022
Capturing Designers’ Experiential Knowledge in Scalable Representation Systems: A Case Study of Knowledge Graphs for Product TeardownsThis research develops a searchable knowledge graph to capture and…
2024
StoryVerse: Towards Co-authoring Dynamic Plot with LLM-based Character Simulation via Narrative PlanningExploring how to build interactive narratives based on Large Language…
2023
Leveraging State-of-the-Art Generative AI Models in Autodesk MayaIn this tutorial, Evan Atherton explains how to use Point-e in…
2017
Project Dreamcatcher: Generative Design Solutions in CADWhat if a CAD system could generate thousands of design options that…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us