We refer to their output as To ensure the model to predict valid label sequences, we append a first-order conditional random field (CRF) layer to the model (Lample et al., 2016).
for a L-layers NN, we mark the input and output of the l th layer at the t th time stamp as x l,t and h l,t .