To do this, first we estimate a bigram language modelq from the actual distribution q of POS sequences observed in u.
second, let p θ denote the distribution of POs sequences that we expect to see in B , that is, POs sequences obtained by 2 the 93% of nodes tagged with NOUN, PROPN, PRON or VERB in Universal Dependencies format.