Skip to Main content Skip to Navigation
Journal articles

Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics

Adnan Al Alwani 1 Youssef Chahir 1
1 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : Action recognition based on the 3D coordinates of body skeleton joints is an important topic in computer vision applications and human robot interaction. At present, most 3D data are captured using recently introduced economical depth sensors. In this study, we explore a new method for skeleton-based human action recognition. In this novel framework, the normalized angles of local joints are first extracted, and then the modified spherical harmonics (MSHs) are used to explicitly model the angular skeleton by projecting the spherical angles onto the unit sphere basis. This process decomposes the skeleton representation into a set of basis functions. A spatiotemporal system of the spherical angles is adopted to construct the static pose and joint displacement over a human action sequence. Consequently, the MSHs coefficients of the joints are used as the discriminative descriptor of the sequence. The extreme learning machine (ELM) classifier and recently published 3D action datasets are used to validate the proposed method. The experimental results show that the proposed approach performs better than many classical methods
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download

https://hal-normandie-univ.archives-ouvertes.fr/hal-01712234
Contributor : Youssef Chahir <>
Submitted on : Tuesday, July 17, 2018 - 2:54:34 PM
Last modification on : Thursday, November 14, 2019 - 3:48:14 PM
Long-term archiving on: : Monday, October 1, 2018 - 6:38:17 AM

File

PRL_YC.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License

Identifiers

Citation

Adnan Al Alwani, Youssef Chahir. Spatiotemporal representation of 3D skeleton joints-based action recognition using modified spherical harmonics. Pattern Recognition Letters, Elsevier, 2016, 83, pp.32-41. ⟨10.1016/j.patrec.2016.05.032⟩. ⟨hal-01712234⟩

Share

Metrics

Record views

366

Files downloads

372