The lowest layers of the ANN tend to represent task-independent features, whereas the topmost layers are more task-specific.
fewer studies have been performed on transfer learning for ANN-based models in the field of natural language processing.