Skip to Main content Skip to Navigation
Conference papers

A neural network based on SPD manifold learning for skeleton-based hand gesture recognition

Xuan Son Nguyen 1 Luc Brun 1 Olivier Lezoray 1 Sébastien Bougleux 1
1 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : This paper proposes a new neural network based on SPD manifold learning for skeleton-based hand gesture recognition. Given the stream of hand's joint positions, our approach combines two aggregation processes on respectively spatial and temporal domains. The pipeline of our network architecture consists in three main stages. The first stage is based on a convolutional layer to increase the discrim-inative power of learned features. The second stage relies on different architectures for spatial and temporal Gaussian aggregation of joint features. The third stage learns a final SPD matrix from skeletal data. A new type of layer is proposed for the third stage, based on a variant of stochastic gradient descent on Stiefel manifolds. The proposed network is validated on two challenging datasets and shows state-of-the-art accuracies on both datasets.
Document type :
Conference papers
Complete list of metadatas

Cited literature [62 references]  Display  Hide  Download

https://hal-normandie-univ.archives-ouvertes.fr/hal-02456437
Contributor : Yvain Queau <>
Submitted on : Monday, January 27, 2020 - 1:16:20 PM
Last modification on : Thursday, February 13, 2020 - 1:51:50 PM

File

Nguyen_A_Neural_Network_Based_...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02456437, version 1

Citation

Xuan Son Nguyen, Luc Brun, Olivier Lezoray, Sébastien Bougleux. A neural network based on SPD manifold learning for skeleton-based hand gesture recognition. IEEE Conference on Computer Vision and Pattern Regognition (CVPR), 2019, Long Beach, United States. ⟨hal-02456437⟩

Share

Metrics

Record views

47

Files downloads

101