We care the most in this paper whether TOD-BERT, a pre-trained language model using aggregated taskoriented corpora, can show any advantage over BERT.
we avoid adding too many additional components on top of its architecture when fine-tuning on each downstream task.