To do so, we follow (Tamaazousti et al., 2017) and analyse the units of Φ (biLSTM layer) before and after finetuning.
we compute the Pearson's correlation between all the units of the layer before and after fine-tuning.