For simplicity we use the mini-batch for this set, but it could be a different set.
the second source of data is a set of sentence pairs automatically extracted from Simple English Wikipedia and English Wikipedia articles by Coster and Kauchak (2011) systems, where each instance pairs a simple and complex sentence representing approximately the same information.