From this example, we also see that the syntactic and semantic information can complement each other to both promote the important context words and blur the irrelevant words.
we argue that the syntactic and semantic information should be allowed to interact earlier in the modeling process to produce more effective representations for EFP.