Tokenisation: determine token (words, punctuation symbols) boundaries in sentences.
the corpus contains both external and intrinsic plagiarism cases, that is, cases where plagiarism is to be identified within the actual suspicious document, without referring to a source document.