6 a concrete example of a biased neuron when transferring from newswire to Tweets domain.
we show the top-10 words activating unit-169 of Φ (from the standard fine-tuning baseline), before fine-tuning (at this stage, the model is trained on the source-dataset WSJ) and during fine-tuning on the TweeBank dataset.