In this case, two vocabularies need to be considered, corresponding respectively to the context vocabulary V c used to define the history; and the prediction vocabulary V p .
this method fails to deliver any probability estimate for words outside of the prediction vocabulary, meaning that a fall-back strategy needs to be defined for those words.