Therefore, an RNN language model with DOC can output a distribution matrix whose rank is identical to one of the true distributions.
,Ã is a better approximation of A than the output of a standard RNN language model.