The best single baseline MT system for DA is MSA-Pivot has a large room for improvement given the oracle upper bound (4.8% BLEU absolute).
we performed manual error analysis on a Dev set sample of 250 sen-tences distributed among the different dialects and genres.