MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector

AbstractMouseLight is a standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. Using this unique combination of hardware components, users can interact with virtual layers of information which augmented physically printed content on paper, supporting a seamless transition between virtual and physical information. In addition to presenting a high fidelity hardware prototype, we develop a set of novel interactions specifically tailored to the unique properties of MouseLight, which differentiate it from related systems such as PenLight. This includes a rich set of bimanual interactions inspired by the ToolGlass interaction metaphor, but applied to physical paper. In addition, our system demonstrates novel displaced interactions, where the user can interact outside of the projection region, using the paper as a physical proxy for virtual interactions. We also report on a preliminary evaluation of the system, which produced encouraging observations and feedback.

Download publication

Related Resources

See what’s new.



The Prevention of Mode Errors Through Sensory Feedback

The use of different kinds of feedback in preventing mode errors was…



Trigger Action Circuits: Leveraging Generative Design to Enable Novices to Design and Build Circuitry

The dramatic decrease in price and increase in availability of…



CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly

We introduce CAPRI-Net, a self-supervised neural net-work for learning…



Collision Anthology: Science-Fiction-Informed Innovation

This project leverages science fiction as a medium to imagine…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us