To find the relevance of each memory m t λ 's context with q i , a match between both is computed.
we do this by taking an inner product as follows: Here, sof tmax(x i ) = e x i ∑ j e x j and attention vector p λ = {p t λ } is a probability distribution over the input memories  the output representation o λ contains weighted contextual summary accumulated from the memory.