We replace S with aS ∈ R N ×dm .
for each of the N way codebook, we use only one d m -dimensional vector to rescale the base codebook C. The number of parameters in S can thus be reduced and the computation of U becomes Now, with the N -way codebook defined by C and S, given an embedding matrix E with V vocabularies (i.e.