So we introduce a simple attention mechanism to consider the importance of different state vectors.
for each sentence s i in one document d, which contains the sentences vectors s 1 , s 2 , .., s m , we integrate the weights into bi-directional state vector h i and h i .