Unlike the traditional dropout method where neurons are dropped randomly with the same probability, we encode global information into dropout.
we drop words based on their importance which are calculated from training data via a novel Naïve Bayes (NB) weighting technique.