The LM score features are extracted from large amounts of news article data, and are good representation of the general importance of bigrams for the test domain.
word-Net information is collected from a more general aspect, which may not be a very good choice for this task.