For non-keyphrases, MemNN highlights non-topic words, e.g., "be", "to".
features learned for keyphrases and non-keyphrases are different, which can thus benefit keyphrase tagger to correctly distinguish keyphrases from non-keyphrases.