Each state representation u IN k is calculated by an attention over the whole representation of history: where we assign each hidden state m different kinds of scores and perform a weighted average.
their modules like belief tracker still needs to be trained separately before end-to-end training.