From our preliminary experiments, we found out that keeping the transferred parameters fixed during the subsequent step usually produces worse results for both models.
in the subsequent step, the transferred parameters are not fixed but updated together with the rest of the network.