A Novel Video Prediction Algorithm based on Robust Spatiotemporal Convolutional LongShort Term Memory - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

A Novel Video Prediction Algorithm based on Robust Spatiotemporal Convolutional LongShort Term Memory

Résumé

Recently, video prediction algorithms based on neural networks have become a promising research direction. Therefore, a new recurrent video prediction algorithm called ”Robust Spatiotemporal Convolutional Long Short-Term Memory” (Robust-ST-ConvLSTM) is proposed in this paper. Robust-ST-ConvLSTM proposes a new internal mechanism that is able to regulate efficiently the flow of spatiotemporal information from video signals based on higher order Convolutional-LSTM. The spatiotemporal information is carried through the entire network to optimize and control the prediction potential of the ConvLSTM cell. In addition, in traditional ConvLSTM units, cell states, that carry relevant information throughout the processing of the input sequence, are updated using only one previous hidden state, which holds information on previous data unit already seen by the network. However, our Robust-ST-ConvLSTM unit will rely on N previous hidden states, that provide temporal context for the motion in video scenes, in the cell state updating process. Experimental results further suggest that the proposed architecture can improve the state-of-the-art video prediction methods significantly on two challenging datasets, including the standard Moving MNIST dataset, and the commonly used video prediction KTH dataset, as human motion dataset.
Fichier principal
Vignette du fichier
Robust_ST_ConvLSTM_ICICT2022.pdf (807.65 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03412403 , version 1 (26-08-2022)

Identifiants

Citer

Wael Saideni, David Helbert, Fabien Courrèges, Jean Pierre Cances. A Novel Video Prediction Algorithm based on Robust Spatiotemporal Convolutional LongShort Term Memory. International Congress on Information and Communication Technology, Feb 2022, London, United Kingdom. ⟨10.1007/978-981-19-1610-6_17⟩. ⟨hal-03412403⟩
155 Consultations
100 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More