Publication | ACM SIGCHI Conference on Human Factors in Computing Systems 2019


Enabling Semantic Design of Expressive Robot Behaviours


Geppetto: Enabling Semantic Design of Expressive Robot Behaviours

Ruta Desai, Fraser Anderson, Justin Matejka, Stelian Coros, James McCann, George Fitzmaurice, Tovi Grossman

ACM SIGCHI Conference on Human Factors in Computing Systems 2019 (Best Paper Award – Top 1%)

Expressive robots are useful in many contexts, from industrial to entertainment applications. However, designing expressive robot behaviors requires editing a large number of unintuitive control parameters. We present an interactive, data-driven system that allows editing of these complex parameters in a semantic space. Our system combines a physics-based simulation that captures the robot’s motion capabilities, and a crowd-powered framework that extracts relationships between the robot’s motion parameters and the desired semantic behavior. These relationships enable mixed-initiative exploration of possible robot motions. We specifically demonstrate our system in the context of designing emotionally expressive behaviors. A user-study finds the system to be useful for more quickly developing desirable robot behaviors, compared to manual parameter editing.

Download publication

Related Resources



TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual Reality

This research provides an approachable editing experience by…



A Classification of Opening Posts in Commercial Software Help Forums

The opening posts in software help forums reflect the users’…



Regularizing a singular special Lagrangian variety

Consider two special Lagrangian submanifolds with boundary in…



A Model of Navigation for Very Large Data Views

Existing user performance models of navigation for very large…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us