Publication

MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector

AbstractMouseLight is a standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. Using this unique combination of hardware components, users can interact with virtual layers of information which augmented physically printed content on paper, supporting a seamless transition between virtual and physical information. In addition to presenting a high fidelity hardware prototype, we develop a set of novel interactions specifically tailored to the unique properties of MouseLight, which differentiate it from related systems such as PenLight. This includes a rich set of bimanual interactions inspired by the ToolGlass interaction metaphor, but applied to physical paper. In addition, our system demonstrates novel displaced interactions, where the user can interact outside of the projection region, using the paper as a physical proxy for virtual interactions. We also report on a preliminary evaluation of the system, which produced encouraging observations and feedback.

Download publication

Related Resources

See what’s new.

Publication

2023

Assemble Them All: Physics-Based Planning for Generalizable Assembly by Disassembly

This work proposes a novel method to efficiently plan physically…

Publication

2009

Multimodal selection techniques for dense and occluded 3D virtual environments

Object selection is a primary interaction technique which must be…

Publication

2011

Exploiting Structure in Weighted Model Counting Approaches to Probabilistic Inference

Previous studies have demonstrated that encoding a Bayesian network…

Publication

2014

Duet: Exploring Joint Interactions on a Smart Phone and a Smart Watch

The emergence of smart devices (e…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us