Back to the extra predictor (FC layer of random branch), it is important to note that both branches are equally important for making a decision for every class, i.e., no weight is applied on the dimensions ofŷ p w i andŷ r w i .
this latter is sub-optimal since we, a priori, do not know which kind of units (random or pre-trained) is better for making a decision.