The necessity to search for the whole sentences in the corpus and not only for some smaller context (considering, for example, just left and right neigh-bor), which would lead to lower sparsity, is rationalized by the following example: Their children went to school.
the sampler converges to similar results for both the initializations.