For calculating r c , we further use a bi-directional extension of the original LSTM structure.
the base LSTM is applied to the input character sequence both from left to right and from right to left, leading to two hidden node sequences For the current character c 0 , h cL 0 and h cR 0 are concatenated to form the final vector r c .