Using the types only, while ignoring the indices, avoids learning biases that arise from the arbitrary ordering of the tokens in the training data.
it does not allow distinguishing between entries with the same type for generation decisions; for example, the common case where multiple cities are mentioned in an interaction.