where h is a simple linear layer for classification, and the parameters of both language model and the linear layer will be fine-tuned on the downstream commonsense reasoning task.
in the training process, the objective is to minimize the negative log-likelihood of ground-truth answers a * i as follows.