Guo Wen ; Bie Xiaoyu ; Alameda-Pineda Xavier ; Moreno-Noguer Francesc

Abstract

Human motion prediction aims to forecast future poses given a sequence ofpast 3D skeletons. While this problem has recently received increasingattention, it has mostly been tackled for single humans in isolation. In thispaper, we explore this problem when dealing with humans performingcollaborative tasks, we seek to predict the future motion of two interactedpersons given two sequences of their past skeletons. We propose a novel crossinteraction attention mechanism that exploits historical information of bothpersons, and learns to predict cross dependencies between the two posesequences. Since no dataset to train such interactive situations is available,we collected ExPI (Extreme Pose Interaction), a new lab-based personinteraction dataset of professional dancers performing Lindy-hop dancingactions, which contains 115 sequences with 30K frames annotated with 3D bodyposes and shapes. We thoroughly evaluate our cross interaction network on ExPIand show that both in short- and long-term predictions, it consistentlyoutperforms state-of-the-art methods for single-person motion prediction.