Our work is most similar to the work of Zoph and Knight (2016) and Anastasopoulos and Chiang 2018, which share a decoder and two separate attention models to read from two different sources.
we share information at the level of reconstructed frames.