The part of speech tagger has similar architecture to the one used for training the embeddings.
we have changed some of the network parameters, specifically, we use a hidden layer of size 300 and learning rate of 0.3.