Practically, we utilize position and POS embedding (Li et al., 2018b) generated by word embedding tool.
the embedding layer is a W ∈ R d×v , where d is the dimension and v denotes the number of instances.