Attentive Recurrent Network (ARN) We can also extend RNN by recurring over a set of feature vectors extracted with an attention model, which allows the model to learn a compact, abstractive feature vectors over the input sequence.
the ARN performs T recurrent steps on the attentive output of the input representation H n−1 r : The output representations H n ARN = {h n 1 , .