To obtain an invariant representation, we employ a transformation layer and propose to align the transformed representation so that it is not distinguishable whether it comes from the source or the target.
we transform the representation h i at each position i linearly and obtain where W inv and b inv are learnable parameters.