We use the term "extended vocabulary" to denote the union of the slot vocabulary and all words from the input utterances.
the probability distribution over the extended vocabulary is calculated as: the model makes the final predictions using a weighted combination of the predictions from two individual components.