These decoders generate tokens from left to right, at each step giving a distribution over possible next tokens, conditioned on both the input and all the tokens generated so far.
as our model is agnostic to both the model architecture and the target metric, we see the exploration of more diverse and ambitious model-target metric pairs as a clear avenue for future work.