For notational convenience we use w to denote non-pivots in both domains when the domain is clear from the context.
unlike those methods that use the softmax function to convert inner-products to probabilities, we directly use the inner-products without any further transformations, thereby avoiding computationally expensive distribution normalizations over the entire vocabulary.