This work is about using data from peoples movements to learn AI methods for controlling the bahaviour of animated characters. It pioneered the use of machine learning for virtual characters, particularly for AI aspects (as opposed to animation, where it was already quite common).
One of the key aspects of this work was the development of two person capture techniques which allowed us to capture both the behaviour of the character, but also the behaviour of the person the character was interacting with. By synchronising the two data sets, we were able to learn a model that could generate responses from the character. We now call this technique “Interactive Performance Capture”.
- Responsive Listening BehaviorGillies, Marco , Pan, Xueni, Slater, Mel and Shawe-Taylor, John. 2008. Responsive Listening Behavior. Computer Animation and Virtual Worlds, 19(5), pp. 579-589. ISSN 1546-4261 [Article] Read more »
- Learning Finite State Machine Controllers from Motion Capture DataGillies, Marco . 2009. Learning Finite State Machine Controllers from Motion Capture Data. IEEE Transactions on Computational Intelligence and AI in Games, 1(1), pp. 63-72. ISSN 1943-068X
Also published on Medium.