1(b), learns a feature mask, which is applied on each word annotation h i .
a gate mechanism with a sigmoid activation function, generates a mask-vector from each c(w i ) with values between 0 and 1 (black and white dots in Fig.