In particular, we can show that when y is fixed (observed), the {z n } N n=1 variables are d-separated (Bishop, 2006) i.e., are mutually independent.
the transformer model however fails to decode the later portions of the long input accurately.