In most cases, the rank of matrix HW is D h N because D h N is smaller than V and U in common RNN language models.
an RNN language model cannot express true distributions if D h N is much smaller than rank(A ).