It is counterintuitive, since experimental results prove that both of those features learn almost the same global and contextual features.
baseline network dominates over pre-trained network as the former learns most of the features learned by the latter.