To summarize this history, content-aware models (Chen et al., 2016a;Kim et al., 2017) similar to attention models in machine translation (Bahdanau et al., 2014) have been proposed.
the proposed models do not need any manual time-decay function, but learn a timedecay tendency directly by introducing a trainable distance vector, and therefore have good SLU accuracy.