Furthermore, if we add LSTM span predictors along with the video LSTM (ExCL 2-{b, c}) we obtain an additional boost in performance.
without a recurrent visual encoder, a recurrent span predictor is essential to capture both uni-modal and cross-modal interactions (ExCL 1-{b, c}).