As future work we wish to explore learning much simpler abstractions such as entity and concepts.
this symbol map helps in two important ways: it helps preserve the linguistic structure, and at the time of prediction it helps replace unknown symbol with the original word.