Prior to the average or mean pooling, each biLSTM output vector is multiplied by a softmax weight, which is determined by the question representation from biL-STM.
given the output vector of biL-STM on the answer side at time step t, h a (t), and the question representation, o q , the updated vector h a (t) for each answer token are formulated below.