Publication | ACM SIGCHI Conference on Human Factors in Computing Systems 2019


Enabling Semantic Design of Expressive Robot Behaviours


Geppetto: Enabling Semantic Design of Expressive Robot Behaviours

Ruta Desai, Fraser Anderson, Justin Matejka, Stelian Coros, James McCann, George Fitzmaurice, Tovi Grossman

ACM SIGCHI Conference on Human Factors in Computing Systems 2019 (Best Paper Award – Top 1%)

Expressive robots are useful in many contexts, from industrial to entertainment applications. However, designing expressive robot behaviors requires editing a large number of unintuitive control parameters. We present an interactive, data-driven system that allows editing of these complex parameters in a semantic space. Our system combines a physics-based simulation that captures the robot’s motion capabilities, and a crowd-powered framework that extracts relationships between the robot’s motion parameters and the desired semantic behavior. These relationships enable mixed-initiative exploration of possible robot motions. We specifically demonstrate our system in the context of designing emotionally expressive behaviors. A user-study finds the system to be useful for more quickly developing desirable robot behaviors, compared to manual parameter editing.

Download publication

Related Resources



Leveraging Robotics for Cleaner Construction Jobsites

The value in Spot’s ability to execute repeatable, autonomous missions…



Stochastic Rendering of Density Fields

Stochastic models are often economical to generate but problematic to…



”I don’t want to feel like I’m working in a 1960s factory”: The Practitioner Perspective on Creativity Support Tool Adoption

Creative practitioners reflect on their values to derive a value…



Machine Shop Safety 101: How to Work Smart & Safe

A primer on machine shop safety from the Fusion 360 team. …

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us