MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector

AbstractMouseLight is a standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. Using this unique combination of hardware components, users can interact with virtual layers of information which augmented physically printed content on paper, supporting a seamless transition between virtual and physical information. In addition to presenting a high fidelity hardware prototype, we develop a set of novel interactions specifically tailored to the unique properties of MouseLight, which differentiate it from related systems such as PenLight. This includes a rich set of bimanual interactions inspired by the ToolGlass interaction metaphor, but applied to physical paper. In addition, our system demonstrates novel displaced interactions, where the user can interact outside of the projection region, using the paper as a physical proxy for virtual interactions. We also report on a preliminary evaluation of the system, which produced encouraging observations and feedback.

Download publication

Related Resources

See what’s new.



Sustainability through Optimal Design of Buildings for Natural Ventilation using Updated Comfort and Occupancy Models

The benefits of incorporating natural ventilation simulation into a…



Exploring the Conformal Constraint Equations

The extended constraint equations arise as a special case of the…



The Effects of Posture on Forearm Muscle Loading During Gripping

The purpose of this study was to quantify the response of the forearm…



Spotlight: Directing Users’ Attention on Large Displays

We describe a new interaction technique, called a spotlight, for…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us