Because each <HEAD, DEP> acts as a single unit in linguistic analysis, the task is to predict a collocation include head word and dependency word given the other words in a context as follows: So despite the fact that the <HEAD, DEP> collocations vectors are initialized randomly, <HEAD, DEP> can eventually capture syntactic and semantic features as a production of the target probability task.
by mapping each collocation to distinct vector representation, the performance must get worse as millions of VP collocation data are available.