Hammerton (2003) and Collobert et al. (2011) are among the first several studies to model sequence labeling using neural networks.
Hammerton (2003) encoded the input sequence using a unidirectional LSTM (hochreiter and Schmidhuber, 1997) while (Collobert et al., 2011) instead used a CNN with character level embedding to encode sentences.