Recurrent networks (RNNs) (Elman, 1990) have recently become very popular for sequence tagging tasks such as entity extraction that involves a set of contiguous tokens.
their ability to identify relations between non-adjacent tokens in a sequence, e.g., the head nouns of two entities, is less explored.