Training random field models is challenging due to numerical intractability of the normalizing constants Z l (λ) and expectations p λ,l [f ].
the TDRF using the "w+c+ws+cs+cpw" features with class number 200 performs comparable to the RNNLM in both perplexity and WER.