Additional examples of success and failure cases are uploaded in the Appendix.
these models do not achieve the same level of consistent performance on generative modeling tasks as opposed to language understanding tasks (Ziegler et al., 2019;Edunov et al., 2019).