Publication | Graphics Interface Conference 2022

It’s Over There

Designing an Intelligent Virtual Agent That Can Point Accurately into the Real World

This paper describes strategies to design an intelligent virtual agent (IVA) to point accurately into the real world. We found that our designed IVA provided pointing perception as accurate as a real person. Our integrated design choices provide a foundation for design factors to consider when designing IVAs for pointing and pave the way for future studies and systems in providing accurate pointing perception.

Download publication

Abstract

It’s Over There: Designing an Intelligent Virtual Agent That Can Point Accurately into the Real World

Fan Wu, Qian Zhou, Ian Stavness, Sidney Fels

Graphics Interface Conference 2022

It is challenging to design an intelligent virtual agent (IVA) that can point from the virtual to the real world and have users accurately recognize where it is pointing due to differences in perceptual cues between the two spaces. We designed an IVA with factors including: a situated display, appearance, and pointing gesture strategy to establish whether it is possible to have an IVA point accurately into the real world. With a real person pointing as a baseline, we performed an empirical study using our designed IVA and demonstrated that participants perceived the IVA’s pointing to a physical location with comparable accuracy to a real person baseline. Specifically, we found that when the IVA is 230 cm away from the targets on average, the IVA outperformed the real person in the vertical dimension (10.22 cm, 28.8% less error) and achieved the same level of accuracy (11.58 cm) horizontally. Our integrated design choices provide a foundation for design factors to consider when designing IVAs for pointing and pave the way for future studies and systems in providing accurate pointing perception.

Associated Researchers

Fan Wu

University of British Columbia

Ian Stavness

University of Saskatchewan

Sidney Fels

University of British Columbia

View all researchers

Related Resources

Publication

2011

Leveraging Cloud Computing and High Performance Computing Advances for Next-generation Architecture, Urban Design and Construction Projects

Architecture and urban design projects are constantly breaking…

Publication

2018

Investigating How Online Help and Learning Resources Support Children’s Use of 3D Design Software

3D design software is increasingly available to children through…

Publication

2023

MoodCubes: Immersive Spaces for Collecting, Discovering and Envisioning Inspiration Materials

In early stages of creative processes, practitioners externalize and…

Project

2019

Command Usage Arc Diagrams

Exploring and analyzing a database of over 60 million commands issued…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us