Recently, researchers have started to work on morphologically informed word embeddings (Botha and Blunsom, 2014;Cao and Rei, 2016), aiming at better capturing syntactic, lexical and morphological information.
different from recent work employing complex attention mechanisms Cui et al., 2017a;Sordoni et al., 2016), our attention mechanism is much more simple with comparable performance so that we can focus on the effectiveness of SAW strategies.