Concurrent work has shown the value of leveraging large amounts of Reddit data to harvest naturally occurring conversations for the purposes of downstream conversational tasks (Zhang et al., 2019).
this work does not address the issue of stylistic control or the effects of scaling models to large sizes, which are central themes of our work.