The underlying intuition is similar to attention for machine translation, which learns alignments between source and target sentences, or attention in question answering, which computes attention weights based on a question and a fact.
these sources for attention are still internal information of the network (the input or previous output predictions).