Hall and Klein (2010) avoid this: they fit a full bigram model by inclusive KL divergence, which refuses to prune any values (see section 3).
they minimized D(µ F →V τ || q θ τ ), where τ was a simple fixed function (a 0-gram model) included so that they were working with distributions (see section 4.3).