The proof that P G P L gives a clear illustration of the label bias problem.
we use averaged stochastic gradient descent with momentum, and we tune the learning rate, learning rate schedule, momentum, and early stopping time using a separate held-out corpus for each task.