It verifies that the multiplicative composition used in our approach is able to introduce new information to the base codebook.
given the over-parameterization of deep neural nets, the effective compression of them has been receiving increasing attention from the research community.