Another interesting observation is that H-LSTM-CRF performs better in unsupervised and semi-supervised settings (i.e., with less target labels).
h-LSTM-CRF adapts better than h-LSTM with small target datasets by exploiting the tag dependencies in the source.