The accuracy obtained by KRR andk 0/1 5−8 on raw text was 82.6%, which is still better than the accuracy of the very same system when tokenization was included (82.0%).
we can conclude that both hypotheses are responsible for the improved results.