For each time step in the BLSTM layer, the hidden vector or the output vector is generated by combining the cell memory vectors from two LSTM of both sides.
all the contextual information across the entire sequence (both question and answer sentences) has been taken into consideration.