These models share the property of producing a single general representation for each word, which can be utilized in a variety of tasks, from POS tagging to semantic role labelling.
here we attempt to decompose the representations into separate seman- tic and syntactic components.