On the one hand, the model reuse previously learned features from left columns via lateral connections (i.e., adapters).
progressive networks also have ability to transfer knowledge from previous tasks to improve convergence Figure 3: Each column is a stacked bidirectional LSTM RNN model.