Assuming that there is little domain shift of input feature spaces, they simplify the problem as homogeneous transfer learning (Weiss et al., 2016).
the word adaptation layer serves as a way to bridge the gap of heterogeneous input spaces, but it does so only at the word level and is context independent.