Although this strategy may not be the best approach and there exist more elaborate attention models (Bahdanau et al., 2014;Luong et al., 2015), the proposed attention model is a proper balance of computational efficiency and complexity.
besides {W,C,S} in CSE models, D and R are added into parameter set which relates to gradients of the loss function Eq.(1).