The total training loss in the supervised adaptation setting can be written as where the second term is the classification loss on the labeled target data set D l T , and the last term is the discrimination loss on both labeled and unlabeled data in the target domain.
bidirectional RNNs (Schuster and Paliwal 1997) capture dependencies from both directions, thus providing two different views of the same sentence.