(2), so as to restrict the space of the valid reasoning operations and boost the convergence rate.
we calculate the correlation ac t,s and pass it through a softmax layer to yield a distribution av t,s over the question words.