The 100-billion-token corpus used in the original publication is not publicly available.
(2016), the first operation consists of constructing an LSTM language model to capture the meaning of words in context.