Since the parameter updates are performed at the end of each episode, we cache the term pair representations and reuse them when the same term pairs are encountered again in the same episode.
the proposed approach is very time efficient -each training epoch takes less than 20 minutes on a single-core CPU using DyNet (Neubig et al., 2017).