Unlike existing approaches, we propose lightweight yet effective methods for performing domain adaptation for neural models.
we introduce adaptation layers on top of existing neural architectures, where no retraining using the source domain data is required.