n}, and their average vector, s = 1/n i w i , s ∈ R d , as follows: Figures 1(a)-1(c) show strong positive correlation between divergence and document length show macro F1 performance of the deep averaging network developed in (Joulin et al., 2017) across datasets: performance considerably drops for higher values of information loss/divergence, e.g.
they can cause efficiency issues because of their large size (d × k); note that the typical value for embedding dimension d is 300 (Pennington et al., 2014;Mikolov et al., 2013).