Data Driven Interactive Virtual Characters

Screen Shot 2014-11-05 at 09.32.51

This work is about using data from peoples movements to learn AI methods for controlling the bahaviour of animated characters. It pioneered the use of machine learning for virtual characters, particularly for AI aspects (as opposed to animation, where it was already quite common).

Screen Shot 2014-11-05 at 09.34.02

One of the key aspects of this work was the development of two person capture techniques which allowed us to capture both the behaviour of the character, but also the behaviour of the person the character was interacting with. By synchronising the two data sets, we were able to learn a model that could generate responses from the character. We now call this technique “Interactive Performance Capture”.

Also published on Medium.