Publication | ACM UIST 2023

WorldSmith

Iterative and Expressive Prompting for World Building with a Generative AI

Abstract

WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI

Hai Dang, Frederik Brudy, George Fitzmaurice, Fraser Anderson

ACM UIST 2023

Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image generation systems to enable users iteratively visualize and modify elements of their fictional world using a combination of text input, sketching, and region-based filling. WorldSmith enables novice world builders to quickly visualize a fictional world with layered edits and hierarchical compositions. Through a formative study (4 participants) and first-use study (13 participants) we demonstrate that WorldSmith offers more expressive interactions with prompt-based models. With this work, we explore how creatives can be empowered to leverage prompt-based generative AI as a tool in their creative process, beyond current “click-once” prompting UI paradigms.

Download publication

Related Resources

Article

2023

Recently Published by Autodesk Researchers

A selection of recently published papers by Autodesk Researchers…

Publication

2022

UNIST: Unpaired Neural Implicit Shape Translation Network

We introduce UNIST, the first deep neural implicit modelfor…

Publication

2022

Communicating Natural Programs to Humans and Machines

The Abstraction and Reasoning Corpus (ARC) is a set of procedural…

Project

2019

CommunityCommands

Just as Amazon and Netflix recommend products and movies to their…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us