Cross-entropy loss based optimization is traditionally used for the sequence generation tasks.
bandit-based variant to improve all metrics but by using multiple bandits which are controlled by a controller, called Hierarchical Multi-reward Bandits (HM-Bandit, Fig. 2).