The updating strategy for w d h,t is derived as The initial vectors w i h,1 cannot be made all zero, since otherwise the l-mode product in Equation (5) would yield all zero φ d h,t (x, y) and the model would never get a chance to be updated.
we initialize the entries of w i h,1 uniformly such that the Frobenius-norm of the weight tensor W is unity.