For each label, we further rank all neurons based on their sensitivity, and obtain an importance ranking for the label.
although it remains unclear what information the neurons exactly encode, we speculate that there are at least two kinds of information, based on the observed patterns: • Coarse-grain types of the current word.