So we do not split them into shorter units (sentences).
the second hierarchy level of (Ruder et al., 2016), that combines the output of consecutive sentences in a document, is superfluous and omitted in our experiments.