In practice, we constitute the function in (12) used for computing weights by fully connected neural networks.
there have been various attempts to improve the performance of RNNs for spoken dialogue systems such as label sampling (Liu and Lane, 2015), the hybrid type of Elman and Jordan (Mesnil et al,.