AR oriented pose matching mechanism from motion capture data

Abstract

Pose matching and skeletal mapping method are an integral part of Augmented Reality (AR) based learning technology. In this paper a mechanism for pose matching is presented based on extraction of skeletal data from the dance trainer's physical movements in the form of color defined images snapped by Kinect, where each pose is modelled by a sequence of key movements and continues data frames. In order to extract the exact matched pose, the frame sequence is divided into pose feature frame and skeletal data frame by the use of pose matching dance training movement recognition algorithm (PMDTMR). This proposed algorithm is compared with other published methods in terms of frame level accuracy and learning time of dance session. The experimental results show that the proposed algorithm outperforms the state of art techniques for successful identification and recognition of matched pose between the dance trainer and the expert of the pre-recorded video through the Kinect sensor. © 2018 Authors.