All of these mixture operations were able to significantly improve over the concatenation baseline.
switching:Max could gain up to 2.2 BLEU points over the concatenation baseline and 0.39 BLEU points over the best performing baseline (i.e.