MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector

AbstractMouseLight is a standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. Using this unique combination of hardware components, users can interact with virtual layers of information which augmented physically printed content on paper, supporting a seamless transition between virtual and physical information. In addition to presenting a high fidelity hardware prototype, we develop a set of novel interactions specifically tailored to the unique properties of MouseLight, which differentiate it from related systems such as PenLight. This includes a rich set of bimanual interactions inspired by the ToolGlass interaction metaphor, but applied to physical paper. In addition, our system demonstrates novel displaced interactions, where the user can interact outside of the projection region, using the paper as a physical proxy for virtual interactions. We also report on a preliminary evaluation of the system, which produced encouraging observations and feedback.

Download publication

Related Resources

See what’s new.



Outsight Network Resident Coral Maker is Racing to Save Coral Reefs

Learn how Australian-based Coral Maker is using technology to restore…



Pen-Based Computing

When I entered graduate school in 1986, I remember reading about the…



Supporting Creative Concept Generation by Engineering Students with Biomimetic Design

Biomimetic design uses ideas from biology as inspiration for design,…



Hierarchical Encapsulation and Connection in a Graphical User Interface: a Music Case Study

Graphical representations consisting of nodes and arcs have proven…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us