Removing all non-rationale text from the training documents (S5) was even worse than removing the rationales (S3).
we cannot hope to do well simply by training on just the rationales (S5), although that approach is improved somewhat in S4 by treating each rationale (similarly to S1) as a separate SVM training example.