Publication
Digital Dérive: Reconstructing Urban Environments based on Human Experience
AbstractThis paper describes a novel method for reconstructing urban environments based on individual occupant experience. The method relies on a low-cost off-the-shelf 360o camera to capture video and audio data from a natural walk through the city. It then uses a custom workflow based on an open-source Structure from Motion (SfM) library to reconstruct a dense point cloud from images extracted from the 360o video. The point cloud and audio data are then represented within a virtual reality (VR) model, creating a multisensory environment that immerses the viewer into the subjective experience of the occupant.This work questions the role of precision and fidelity in our experience and representation of a “real” physical environment. On the one hand, the resulting VR environment is less complete and has lower fidelity than digital environments created through traditional modeling and rendering workflows. On the other hand, because each point in the point cloud is literally sampled from the actual environment, the resulting model also captures more of the noise and imprecision that characterizes our world. The result is an uncanny immersive experience that is less precise than traditional digital environments, yet represents many more of the unique physical characteristics that define our urban experiences.
Download publicationRelated Resources
See what’s new.
01/01/2003
Effects of Team Size on Participation, Awareness, and Technology Choice in Geographically Distributed Teams
In this paper we investigate the effects that team size has on…
01/01/2021
UVStyle-Net: Unsupervised Few-shot Learning of 3D Style Similarity Measure for B-Reps
Boundary Representations (B-Reps) are the industry standard in 3D…
01/01/1994
User learning and performance with marking menus
A marking menu is designed to allow a user to perform a menu selection…
01/01/2014
HybridSpace: Integrating 3D Freehand Input and Stereo Viewing into Traditional Desktop Applications
Technologies for 3D input and output are rapidly advancing, and are…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us