In text classification with neural networks, sentence representation is calculated based on tokens that compose the sentence.
a sentence is first tokenized into meaningful units such as characters, words, and subwords (Zhang et al., 2015;Joulin et al., 2017).