Furthermore, this paper uses skip-connections (He et al., 2016) in order for the CRF network to pay attention to the hidden states of the decoder.
at every time t, the decoder hidden state z t is calculated from the embedding of the previous syllable s t−1 , the decoder state z t−1 , and the context vector c t .