Second, the weights in SIF (and uSIF) are calculated from the statistic of vocabularies on very large corpus (wikipedia).
the weights in GEM are directly computed from the sentences themselves along with the dataset, independent with prior statistical knowledge of language or vocabularies.