We take the annotations of source sentence as a memory instead of using an external memory, and we design a mechanism to directly read from and write to it during translation.
the original source annotations are not accessible in later steps.