We introduce several departures from typical architectures on a finer level.
we incorporate adaptive gating in non-consecutive CNNs  in order to focus temporal averaging in these models on key pieces of the questions.