Due to the dense parameter space, for neural models, the scores of actions in a sequence are relatively more dependent than that in the linear models.
the log probability of an action sequence can not be modeled just as the sum of log probabilities of each action in the sequence, which is the case of structured linear model.