Publication | ACM SIGCHI Conference on Human Factors in Computing Systems 2018


Combining 2D and 3D Sketching for Designing Detailed 3D Objects in Situ


SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ

Rahul Arora, Rubaiat Habib, Tovi Grossman, George Fitzmaurice, Karan Singh

ACM SIGCHI Conference on Human Factors in Computing Systems 2018

We present SymbiosisSketch, a hybrid sketching system that combines drawing in air (3D) and on a drawing surface (2D) to create detailed 3D designs of arbitrary scale in an augmented reality (AR) setting. SymbiosisSketch leverages the complementary affordances of 3D (immersive, unconstrained, life-sized) and 2D (precise, constrained, ergonomic) interactions for in situ 3D conceptual design. A defining aspect of our system is the ongoing creation of surfaces from unorganized collections of 3D curves. These surfaces serve a dual purpose: as 3D canvases to map strokes drawn on a 2D tablet, and as shape proxies to occlude the physical environment and hidden curves in a 3D sketch. SymbiosisSketch users draw interchangeably on a 2D tablet or in 3D within an ergonomically comfortable canonical volume, mapped to arbitrary scale in AR. Our evaluation study shows this hybrid technique to be easy to use in situ and effective in transcending the creative potential of either traditional sketching or drawing in air.

Download publication

Related Resources



Project Reframe: Recording and Editing Motion in Virtual Reality

In a world where content creation has evolved dramatically, Autodesk…



A Classification of Opening Posts in Commercial Software Help Forums

The opening posts in software help forums reflect the users’…



Translating Terms of the Functional Basis into Biologically Meaningful Keywords

Biology has long been recognized as an excellent source of analogies…



Use of Controlled Natural Language to Input Problem Definition for Computer-Aided Design

We intend to develop a computer-aided design (CAD) system that takes…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us