We believed the model would be more robust if the classification layer had inputs from all decoded hidden states directly.
using only the final state vector resulted in higher classification score while using less parameters.