Our HACA model is an encoder-decoder framework comprising multiple hierarchical recurrent neural networks (see Figure 2).
in the encoding stage, the model has one hierarchical attentive encoder for each input modality, which learns and outputs both the local and global representations of the modality.