Lastly, we use softmax to form a distribution over the possible classes.
the probability of predicting the component type at timestep i is defined as: Finally, combining this new prediction task with Equation 2, we arrive at the new training objective: which simply sums the costs of the individual prediction tasks, and the second summation is the cost for the new task of predicting AC type.