To simulate an all-word scenario, we perform a 10-fold cross validation in our experiments, splitting the dataset into equal-sized folds randomly on the target word level.
all sentences for a particular target word fall into the same fold and thus either the training or the test set (but never both).