The main idea behind NPAD algorithm is that a better translation with a higher log-probability may be found by injecting unstructured noise in the transition function of a recurrent network.
where t ∼ N (0, (σ 0 /t) 2 ).