Publication | ACM Symposium on User Interface Software & Technology 2018


Designing a System for Real-Time Orchestration of 3D Modeling Workshops


Maestro: Designing a System for Real-Time Orchestration of 3D Modeling Workshops

Volodymyr Dziubak, Ben Lafreniere, Tovi Grossman, Andrea Bunt, George Fitzmaurice

ACM Symposium on User Interface Software & Technology 2018

Instructors of 3D design workshops for children face many challenges, including maintaining awareness of students’ progress, helping students who need additional attention, and creating a fun experience while still achieving learning goals. To help address these challenges, we developed Maestro, a workshop orchestration system that visualizes students’ progress, automatically detects and draws attention to common challenges faced by students, and provides mechanisms to address common student challenges as they occur. We present the design of Maestro, and the results of a case-study evaluation with an experienced facilitator and 13 children. The facilitator appreciated Maestro’s real-time indications of which students were successfully following her tutorial demonstration, and recognized the system’s potential to “extend her reach” while helping struggling students. Participant interaction data from the study provided support for our follow-along detection algorithm, and the capability to remind students to use 3D navigation.

Download publication

Related Resources



MicroMentor: Peer-to-Peer Software Help Sessions in Three Minutes or Less

While synchronous one-on-one help for software learning is rich and…



Physics-based simulation ontology: an ontology to support modelling and reuse of data for physics-based simulation

The current work presents an ontology developed for physics-based…



Contrastive Multi-View Representation Learning on Graphs

We introduce a self-supervised approach for learning node and graph…



HybridSpace: Integrating 3D Freehand Input and Stereo Viewing into Traditional Desktop Applications

Technologies for 3D input and output are rapidly advancing, and are…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us