Also, context vectors are used to predict slot gates, which is essential to be able to trigger the state generator.
using self-supervision to align contextual slot vectors may help get better attention distributions and better slot gate prediction.