Our model is differentiable with respect to time.
we can get the derivative of use W (w, t) with respect to t to model how word w is changing usage at time t. We l2-normalize use W (w, t) beforehand to reduce frequency effects.