Note that alternatively, one could aggregate information about the past predictions through other means like policies or soft attention.
this would introduce extra complexities to the learning process.