The encoder embeds the source sentence x into vectors through an embedding matrix and produces the hidden states using a bidirectional RNN, which represents a forward and a backward sequence.
we have K×Vs is an embedding matrix where K is the word embedding size, and enc 1 and enc 2 are nonlinear functions as in LSTM.