ness for the TGEN system on BAGEL (ρ = 0.33, p < 0.01, see Figure 1).
the wps metric (amongst most others) is not robust across systems and datasets: Its correlation on other datasets is very weak, (ρ ≤ .18) and its correlation with in-formativeness ratings of LOLS outputs is insignificant.