In this experiment, we investigate the effects of locations on the global contextual embedding in our hierarchical model.
we use the global embedding g to augment: • input of final softmax layer ; x • input of sequence labeling encoder; x encoder k = [w k ; c k ; g] Table 5 shows that the global embedding g improves performance when utilized at the relative low layer (row 3) , while g may do harm to performances when adapted at the higher layers (row 0 vs. row 1 & 2).