will not encounter any previously unseen words.
to speed up training during our experiments and, in some cases, to avoid running out of memory, we replaced words appearing twice or fewer times in the data with the special symbol * UNKNOWN * .