For example, the oracle for RNNG lacks F1 optimality guarantees, and softmax margin without exploration often underperforms likelihood for this parser.
exploration improves softmax margin training across all parsers and conditions.