LSTM (-3) LSTM(3-3) LSTM(1-3) 1.298 1.034 0.990 Our deep single task model increases performance over this baseline by 30%.
we see that when we predict both POS and the target task at the top layer, Rademacher complexity is lower and close to a random baseline.