Publication | ACM International Conference on Interactive Tabletops and Surfaces 2022
VideoPoseVR
Authoring Virtual Reality Character Animations with Online Videos
This paper introduces a video-based animation authoring workflow using online videos to author character animations in virtual reality (VR). It leverages the state-of-the-art deep learning approach to reconstruct 3D motions from online videos, caption the motions, and store them in a motion dataset. Creators can import the videos, search in the dataset, modify the motion timeline, and combine multiple motions from videos to author character animations in VR.
Download publicationAbstract
VideoPoseVR: Authoring Virtual Reality Character Animations with Online Videos
Cheng Yao Wang, Qian Zhou, George Fitzmaurice, Fraser Anderson
ACM International Conference on Interactive Tabletops and Surfaces 2022
We present VideoPoseVR, a video-based animation authoring workflow using online videos to author character animations in VR. It leverages the state-of-the-art deep learning approach to reconstruct 3D motions from online videos, caption the motions, and store them in a motion dataset. Creators can import the videos, search in the dataset, modify the motion timeline, and combine multiple motions from videos to author character animations in VR. We implemented a proof-of-concept prototype and conducted a user study to evaluate the feasibility of the video-based authoring approach as well as gather initial feedback of the prototype. The study results suggest that VideoPoseVR was easy to learn for novice users to author animations and enable rapid exploration of prototyping for applications such as entertainment, skills training, and crowd simulations.
Related Resources
2022
It’s Over There: Designing an Intelligent Virtual Agent That Can Point Accurately into the Real World
It is challenging to design an intelligent virtual agent (IVA) that…
2022
MoodCubes: Immersive Spaces for Collecting, Discovering and Envisioning Inspiration Materials
In early stages of creative processes, practitioners externalize and…
2021
Software Learning
This learning project investigates advanced techniques for assisting…
2021
Novel Input & Output
The nature and quality of interaction can be dramatically affected by…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us