Too Stiff, Too Strong, Too Smart: Evaluating Fundamental Problems with Motion Control Policies

Kaixiang Xie¹, Pei Xu², Sheldon Andrews^3,4, Victor Zordan^4,2, Paul G. Kry¹

¹ McGill University, ² Clemson University, ³ École de technologie supérieure, ⁴ Roblox

In PACM on Computer Graphics and Interactive Techniques
(Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2023)

Abstract

teaser SCA 2023 Deep reinforcement learning (DRL) methods have demonstrated impressive results for skilled motion synthesis of physically based characters, and while these methods perform well in terms of tracking reference motions or achieving complex tasks, several concerns arise when evaluating the naturalness of the motion. In this paper, we conduct a preliminary study of specific quantitative metrics for measuring the naturalness of motion produced by DRL control policies beyond their visual appearance. Namely, we propose to study the stiffness of the control policy, in anticipation that it will influence how the character behaves in the presence of external perturbation. Second, we establish two baselines for strength that allow evaluating the use of joint torques in comparison to human performance. Third, we propose the study of variability to reveal the unnatural precision of control policies and how they compare to real human motion. In sum, we aim to establish repeatable measures to assess the naturalness of control policies produced by DRL methods, and we present a set of comparisons from state-of-the-art systems. Finally, we propose simple modifications to improve realism on these axes.

Bibtex

@inproceedings{Xie-2023-PolicyEval,
    author = {Xie, Kaixiang and Xu, Pei and Andrews, Sheldon and Zordan, Victor B and Kry, Paul G},
    title = {Too Stiff, Too Strong, Too Smart: Evaluating Fundamental Problems with Motion Control Policies},
    journal = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
    publisher = {ACM New York, NY, USA},
    year = {2023},
    volume = {6},
    number = {3},
    pages = {1--17},
    doi = {10.1145/3606935}
}