For the input-to-hidden matrix W x the linear combination (W x x t ) is normally distributed.
sampling the same W x for all timesteps and sampling the same noise i for preactivations for all timesteps are not equivalent.