These measures are based on the probability distribution over the whole vocabulary.
if the test text is w 1 n , then perplexity is based on the values of P(w i |w i-1 ), and the new measures will be based on the values of P(w|w i-1 ) for all w in the vocabulary.