Space correction based on learning To correct the spaces within multi-token words based on learning methods, a model was trained to find words with multiple parts separated by spaces.
we can take all parts of a word as one token.