Skip to Main content Skip to Navigation
Journal articles

Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics

Adnan Al Alwani 1 Youssef Chahir 1 
1 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image et Instrumentation de Caen
Abstract : Action recognition based on the 3D coordinates of body skeleton joints is an important topic in computer vision applications and human robot interaction. At present, most 3D data are captured using recently introduced economical depth sensors. In this study, we explore a new method for skeleton-based human action recognition. In this novel framework, the normalized angles of local joints are first extracted, and then the modified spherical harmonics (MSHs) are used to explicitly model the angular skeleton by projecting the spherical angles onto the unit sphere basis. This process decomposes the skeleton representation into a set of basis functions. A spatiotemporal system of the spherical angles is adopted to construct the static pose and joint displacement over a human action sequence. Consequently, the MSHs coefficients of the joints are used as the discriminative descriptor of the sequence. The extreme learning machine (ELM) classifier and recently published 3D action datasets are used to validate the proposed method. The experimental results show that the proposed approach performs better than many classical methods
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download
Contributor : Youssef Chahir Connect in order to contact the contributor
Submitted on : Tuesday, July 17, 2018 - 2:54:34 PM
Last modification on : Saturday, June 25, 2022 - 9:51:57 AM
Long-term archiving on: : Monday, October 1, 2018 - 6:38:17 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License



Adnan Al Alwani, Youssef Chahir. Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics. Pattern Recognition Letters, Elsevier, 2016, 83, pp.32-41. ⟨10.1016/j.patrec.2016.05.032⟩. ⟨hal-01712234⟩



Record views


Files downloads