In our network, both the source specific part and the common part contribute positively to the source classification objective (i.e., minimize the mis-classification loss).
for the domain divergence objective, the common part contributes positively (i.e., tries to minimize divergence) whereas the source specific part contributes negatively (i.e., tries to maximize divergence).