Finally, auxiliary trees of the form (β 5 ) generate a reparandum word M i is inserted; the weight of such a tree is The TAG just described is not probabilistic; informally, it does not include the probability costs for generating the source words.
it is easy to modify the TAG so it does include a bigram model that does generate the source words, since each nonterminal encodes the preceding source word.