Although the pre-training objective of Code-BERT does not include generation-based objectives , we would like to investigate to what extent does CodeBERT perform on generation tasks.
we study code-to-NL generation, and report results for the documentation generation task on CodeSearchNet Corpus in six programming languages.