The coupling formulation is inspired by the Multimodal RNN that generates textual description from visual data .
unlike Karpathy's approach, we do not allow the feature that is generated by the CNN component to diminish between distant timesteps (i.e.