We introduce an Addressing Function as α = A(M, q), which calculates the probabilities of each slot of the memory being selected and invoked.
we define: where σ defines a non-linear layer, q is the query vector, b is the parameter, M is the memory to be addressed, M k is the k-th slot of M , and α k is the k-th element in vector α.