Exécution de notre outil de synthèse sur un nouvel article

Vérifiez l’article ci-dessous, puis lancez sa synthèse.


Fusing Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks

Songyang Zhang (Zhejiang University), Yang Yang (University of Technology Sydney, Zhejiang University), Jun Xiao (Zhejiang University), Xiaoming Liu (Michigan State University), Yi Yang (University of Technology Sydney, Zhejiang University), Di Xie (Hikvision (China)), Yueting Zhuang (Zhejiang University)

IEEE Transactions on Multimedia
DOI: 10.1109/tmm.2018.2802648 (Computer Science)
Licence : non indiquée (tous droits réservés)

Résumé : Recent skeleton-based action recognition approaches achieve great improvement by using recurrent neural network (RNN) models. Currently, these approaches build an end-to-end network from coordinates of joints to class categories and improve accuracy by extending RNN to spatial domains. First, while such well-designed models and optimization strategies explore relations between different parts directly from joint coordinates, we provide a simple universal spatial modeling method perpendicular to the RNN model enhancement. Specifically, according to the evolution of previous work, we select a set of simple geometric features, and then separately feed each type of features to a three-layer LSTM framework. Second, we propose a multistream LSTM architecture with a new smoothed score fusion technique to learn classification from different geometric feature streams. Furthermore, we observe that the geometric relational features based on distances between joints and selected lines outperform other features and the fusion results achieve the state-of-the-art performance on four datasets. We also show the sparsity of input gate weights in the first LSTM layer trained by geometric features and demonstrate that utilizing joint-line distances as input require less data for training.

Publié le 05 Fév. 2018