In addition, the slot error rate (ERR) as described in Section 3.5 was computed as an auxiliary metric alongside the BLEU score.
for the experiments it is computed at the corpus level, by averaging slot errors over each of the top 5 realisations in the entire corpus.