Need help with AttentionConvLSTM?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

GuangmingZhu
180 Stars 52 Forks MIT License 9 Commits 19 Opened issues

Description

"Attention in Convolutional LSTM for Gesture Recognition" in NIPS 2018

Services available

!
?

Need anything else?

Contributors list

# 315,728
Python
9 commits

AttentionConvLSTM

Prerequisites

1) Python 2.7 2) Tensorflow-1.2
3) The implementation files of the variants of ConvLSTM are in the local dir "patchs". You need merge them with the corresponding files of TF-1.2.

Get the pretrained models

The trained models can be obtained from the below link:
Link: https://pan.baidu.com/s/1O-U_Q-5i9wxOA0MDyi3Idg Code: immi

How to use the code

Prepare the data

1) Convert each video files into images. 2) Replace the path "/ssd/dataset" in the files under "dataset_splits"

Training

1) Use training_*.py to train the networks for different datasets and different modalities.

Testing

1) Use testing_*.py to evaluate the trained networks on the valid or test subsets of Jester or IsoGD.

Citation

Please cite the following paper if you feel this repository useful.
http://papers.nips.cc/paper/7465-attention-in-convolutional-lstm-for-gesture-recognition http://openaccess.thecvf.com/contentICCV2017workshops/w44/html/ZhangLearningSpatiotemporalFeaturesICCV2017_paper.html http://ieeexplore.ieee.org/abstract/document/7880648/

@article{ZhuNIPS2018,
  title={Attention in Convolutional LSTM for Gesture Recognition},
  author={Liang Zhang and Guangming Zhu and Lin Mei and Peiyi Shen and Syed Afaq Shah and Mohammed Bennamoun},
  journal={NIPS},
  year={2018}
}
@article{ZhuICCV2017,
  title={Learning Spatiotemporal Features using 3DCNN and Convolutional LSTM for Gesture Recognition},
  author={Liang Zhang and Guangming Zhu and Peiyi Shen and Juan Song and Syed Afaq Shah and Mohammed Bennamoun},
  journal={ICCV},
  year={2017}
}
@article{Zhu2017MultimodalGR,
  title={Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM},
  author={Guangming Zhu and Liang Zhang and Peiyi Shen and Juan Song},
  journal={IEEE Access},
  year={2017},
  volume={5},
  pages={4517-4524}
}

Contact

For any question, please contact

  [email protected]

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.