This dense representation should preserve the information from the bag-of-words input, meanwhile alleviate data sparse problem.
we use a specially designed mechanism called auto-encoder to solve this problem.