In comparison to LSTM and CCNN-LSTM, LBL2 SW ordSS 's lower performance on test data was expected as the former are more non-linearly complex language models.
for tasks like spoken term detection, having low perplexities on most frequent set of words is not good enough and hence, we compare LMs on the perplexity of a rare-word based test set.