Given x, y, during training of Phase I (in blue), we fix P rec to provide the reward R(q, z), then P split can be learnt by the REINFORCE algorithm.
let f j = softmax(A :,j ), where f j ∈ R n denotes the attention weights on x according to y j .