In-scope accuracy suffers for all models using the undersampling scheme when compared to training on the full dataset using the oos-train and oos-threshold approaches shown in Table 2.
our dataset also covers 150 intent classes over 10 domains, capturing the breadth that a production taskoriented agent must handle.