Then we use a multi-level copy mechanism (K-B copy and context copy), which allows copying from KBs and textual contexts.
we first map the input of the decoder into an embedding representation by looking up word embedding matrix, then we use position embedding (Vaswani et al., 2017) to enhance sequential information.