Publication

An Looking Beyond the Visible Scene

A common thread that ties together many prior works in scene understanding is their focus on the aspects directly present in a scene such as its categorical classification or the set of objects. In this work, we propose to look beyond the visible elements of a scene; we demonstrate that a scene is not just a collection of objects and their configuration or the labels assigned to its pixels – it is so much more. From a simple observation of a scene, we can tell a lot about the environment surrounding the scene such as the potential establishments near it, the potential crime rate in the area, or even the economic climate. Here, we explore several of these aspects from both the human perception and computer vision perspective. Specifically, we show that it is possible to predict the distance of surrounding establishments such as McDonald’s or hospitals even by using scenes located far from them. We go a step further to show that both humans and computers perform well at navigating the environment based only on visual cues from scenes. Lastly, we show that it is possible to predict the crime rates in an area simply by looking at a scene without any real-time criminal activity. Simply put, here, we illustrate that it is possible to look beyond the visible scene.

Download publication

Related Resources

See what’s new.

Publication

2007

The Software That Will Take Digital F/X to the Next Level of Awesome

Jos Stam is standing on a pearl-white beach under a cloudless sky…

Publication

1995

Some Design Refinements and Principles on the Appearance and Behavior of Marking Menus

This paper describes some design refinements on marking menus and…

Publication

2011

Discovery of intrinsic primitives on triangle meshes

The discovery of meaningful parts of a shape is required for many…

Article

2022

Missed AU 2022? Watch these sessions from Autodesk Research

Check out the Autodesk Research panels and presentations from Autodesk…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us