We observed that the character-level BiLSTM outperformed the CNN by 0.1% on the PTB-WSJ development set, and hence in all of our experiments we use the character-level BiLSTM.
we generate a character-level representation for each word by feeding its character embeddings into the BiLSTM and obtaining the concatenated final states.