We use POS embeddings only for the MSRP task.
for MSRP, we concatenate all word and POS embeddings and obtain Dim = Dim g + Dim p + Dim k = 525-dimension vectors for each input word; for SICK and MSRVID we only use Dim = 300-dimension GloVe embeddings.