The baseline models are trained on the Penn Treebank only.
instead of learning and adapting the neural network on millions of training sentences-which can be very timeconsuming or even infeasible in some cases-we design a domain adaptation gating mechanism which can be used in recurrent neural networks and quickly learn the out-of-domain knowledge directly from the word vector representations with little speed overhead.