We decided to use a training dataset that achieved the best results over datasets radically different from the training material in the STS challenge of Semeval 2012.
for the FNWN and OnWN datasets, we arbitrarily selected the training material achieving best results over the 2012 surprise.OnWN; for the headlines and SMT datasets we maximized performance training over surprise.SMTnews.