For the purpose of augmenting the corpus, we discarded the N-grams where words at the beginning or ending of N-gram are sensitive to preceding and succeeding strings.
if the beginning or end of the N-gram is a onecharacter word and is not in a predefined white list (punctuations, and a part of particles), the Ngram is discarded by this step.