Training these models took far longer than our neural-network model, due to the need to use the forward-backward algorithm with a 425×425-dimensional transition matrix during training (rather than considering each word's category independently).
we only experimented with the Turian-50 embeddings with a 7word context window, which attained the best performance using the neural network.