Publication | ACM SIGCHI Conference on Human Factors in Computing Systems 2018

SymbiosisSketch

Combining 2D and 3D Sketching for Designing Detailed 3D Objects in Situ

Abstract

SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ

Rahul Arora, Rubaiat Habib, Tovi Grossman, George Fitzmaurice, Karan Singh

ACM SIGCHI Conference on Human Factors in Computing Systems 2018

We present SymbiosisSketch, a hybrid sketching system that combines drawing in air (3D) and on a drawing surface (2D) to create detailed 3D designs of arbitrary scale in an augmented reality (AR) setting. SymbiosisSketch leverages the complementary affordances of 3D (immersive, unconstrained, life-sized) and 2D (precise, constrained, ergonomic) interactions for in situ 3D conceptual design. A defining aspect of our system is the ongoing creation of surfaces from unorganized collections of 3D curves. These surfaces serve a dual purpose: as 3D canvases to map strokes drawn on a 2D tablet, and as shape proxies to occlude the physical environment and hidden curves in a 3D sketch. SymbiosisSketch users draw interchangeably on a 2D tablet or in 3D within an ergonomically comfortable canonical volume, mapped to arbitrary scale in AR. Our evaluation study shows this hybrid technique to be easy to use in situ and effective in transcending the creative potential of either traditional sketching or drawing in air.

Download publication

Related Resources

Publication

2012

Interactive Modeling with Mesh Surfaces

In the world of modern surface design tools, a mesh is simply a data…

Publication

2009

Physics-based Generative Design

We present a physics-based generative design approach to interactive…

Publication

1995

Some Design Refinements and Principles on the Appearance and Behavior of Marking Menus

This paper describes some design refinements on marking menus and…

Publication

2001

User Interfaces for Volumetric Displays

Although still in the prototype stage, three-dimensional volumetric…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us