Research talk: Evaluating human-like navigation in 3D video games

Опубликовано 25 января 2022, 1:40

Speakers:
Raluca Georgescu, Research Software Engineer II, Microsoft Research Cambridge
Ida Momennejad, Senior Researcher, Microsoft Research NYC

On the path to developing agents that learn complex human-like behavior, a key challenge is the need to quickly and accurately quantify human-likeness. While human assessments of such behavior can be highly accurate, speed and scalability are limited. The researchers address these limitations through a novel automated Navigation Turing Test (NTT) that learns to predict human judgments of human-likeness. They demonstrate the effectiveness of their automated NTT on a navigation task in a complex 3D environment. They investigated six classification models to shed light on the types of architectures best suited to this task, and they validated them against data collected through a human NTT. The best models achieve high accuracy when distinguishing true human and agent behavior. At the same time, the researchers show that predicting finer-grained human assessment of agents’ progress towards human-like behavior remains unsolved. Their work takes an important step towards agents that more effectively learn complex human-like behavior.

Learn more about the 2021 Microsoft Research Summit: Aka.ms/researchsummit