We use the standard multiclass cross-entropy as the objective function when training the neural networks.
their structure fits many NLP tasks, when the interpretation of a single sentence is viewed as analyzing a sequence of tokens.