Their visualization results show some interesting properties of the memory neurons in LSTM unit.
their exploration on character-based model does not intend to correlate high-level linguistic knowledge, which are intuitively required for sequential modelling of a sentence.