(2014);  mixed a small set of crowd-annotated labels with purely DS-generated noise labels.
given the raw input representation x and the corresponding action vector a, we define the reward as follows: where the total reward is composed of two parts: one is the log-likelihood term to pursue the high prediction confidence and the other is the sparse ratio term to induce sparsity in terms of retained tokens.