2018, we perform standard text pre-processing and tokenization.
questions are first converted to lower case and then trimmed to a maximum of 14 words, and the words that appear less than 5 times are replaced with an "<unk>" token.