However, notice that the recurrent dependency between h n ⌧ +1 and h n 1 ⌧ shifts one layer downwards  per-segment, which differs from the same-layer recurrence in conventional RNN-LMs.
the largest possible dependency length grows linearly w.r.t.