We did not find it beneficial to apply a scaling factor when adding this loss to the main cross-entropy loss in our experiments.
while a cascade would use the source-text outputs of the first stage as inputs into the second stage, in this model the second stage directly computes attentional context vectors over the decoder states of the first stage.