The approach of Gildea and Hofmann (1999) overcomes this difficulty by using representations constructed with pLSA, which have a direct probabilistic interpretation.
the probability of an upcoming word given the history can be derived naturally and directly, avoiding the need for ad-hoc transformations.