From Gestures to Greatness: Autodesk Research Transforms Filmmaking at MIT AI Hackathon

What if a simple gesture could bring your next film idea to life?

At the MIT AI Filmmaking Hackathon, Autodesk Research and Wonder Dynamics empowered 650 creatives—from academia, industry, and emerging storytellers—with intuitive, gesture-driven tools. The result? More than 100 short films that pushed the boundaries of AI-assisted filmmaking.

Filmmakers had access to several technologies, and Autodesk showcased two innovative tools:

• Project Reframe – a VR-based research prototype from Autodesk for recording and editing motion in 3D.
• Autodesk Flow Studio (formerly Wonder Studio) – AI-driven motion capture, camera tracking, animation & compositing tools – built to fit existing pipelines.

These tools allowed teams of all skill levels to animate digital characters and explore storytelling ideas without needing complex pipelines or expert training. Attendees were enthusiastic – lining up to test the tools and sharing how easy it felt to animate with gestures.

Among all the film submissions, the judges recognized more than 40 that used Project Reframe and/or Autodesk Flow Studio as finalists. Special Autodesk prizes for the use of each tool went to:

• Machine Learning, a film created using Project Reframe
• Oscillating Rhythmic Vinyl (O.R.V.8), a film created using Flow Studio

Both teams have been invited to join the Autodesk Research Residency Program, where they’ll continue exploring creative workflows for AI-assisted filmmaking.

In addition to the high-energy hackathon, a micro-conference ran in parallel – bringing thoughtful conversation to the forefront of the AI filmmaking space. Through a series of panels and talks, experts explored themes ranging from ethics in AI art to the role of spatial computing in storytelling. One standout moment featured David Ledo, Principal Research Scientist at Autodesk, who shared insights on AI, Art, and Creativity—emphasizing how technology can augment, not replace, human expression.

By observing both the hackathon and conference, two key trends emerged:

• A need for artist-centered AI/ML tools – Creators want tools that meet them where they are, safeguard their IP, and streamline rather than disrupt creative flow.
• Growing interest in AI for pre-production – There’s clear demand for tools that help teams rapidly ideate, organize, and manage narrative elements earlier in the filmmaking process.

The event also underscored a strong appetite for greater integration between AI tools. Many teams expressed interest in bridging platforms like Project Reframe and Flow Studio with broader pre-production workflows to enable a more cohesive creative pipeline.

Want to experiment with Reframe? If you have a Quest 2/3/3S/Pro and want to try the Project Reframe App, you can join the AppLab release channel here: https://www.meta.com/s/8NvN4wqM0 (it will show up in your App Library on your headset).

Learn more about Autodesk Flow Studio.