In this paper, we show that one can in fact partly recover the order information.
given a set of documents in unigram-count BOW representation, one can recover a non-trivial bigram language model (LM) 1 , which has part of the power of a bigram LM trained on ordered documents.