One practical solution is to restrict the output vocabulary to a short-list composed of the most frequent words (Schwenk, 2007).
the usual size of the short-list is under 20k, which does not seem sufficient to faithfully represent the translation models of section 2.