For some tasks with fewer noises, including R 0 , R 7 , R u 7 and R u 9 , our method can obtain small improvements.
we define our objective as: where x denotes the input representation of the instance s. By taking the derivative of J(Θ) with respect to Θ, we can obtain the gradient Besides, we utilize the -greedy trick to balance exploration and exploitation.