For simplicity and space issue, we denote the operation of an LSTM unit on x i as LSTM(x i ).
the contextualized word representation h (0) i ∈ R 2dim h is obtained as follows: The above word-level representation has not considered the target information yet.