We further propose to improve this approach to alleviate the forgetting problem by anchoring the sentence embedding space.
we utilize an explicit alignment model to mitigate the sentence embedding distortion of the learned model when training on new data and new relations.