Given the k-th source sentence x (k) , we use x i ∈ R D×1 to denote the vector representation of the ith source word x i , which is a sum of word embedding and positional encoding.
the initial matrix representation of where X ∈ R D×I is the concatenation of all vector representations of source words.