Since FT-AttRNN is only trained on new data, it is oftentimes overwhelmed by new knowledge and results in forgetting the old knowledge.
fT-Cp-AttRNN can be treated as a naive solution to achieve both goals by almost duplicating the model again and again.