Similarly, for IL, we have To utilize information extracted from English side, we use h E f [n E − 1] and h E b [0] from the last steps of bi-directional LSTM to initialize the starting states of LSTM hidden layers in IL side.
during training, errors can be back propagated to English side neural networks through these two vectors.