This selfcontained adapter module can be injected between any two layers of the network, without disrupting the original operation.
when using adapters for domain adaptation, we follow the following two step approach: • Pre-training: Pre-train the NMT model on a large open-domain corpus.