The attention network produces a scalar attention weight a i for the i th sentence which is given by In the proposed model, we make the simplifying assumption that the visual representation of the current sentence does not depend on future sentences.
it can be completely determined from the previous sentences in the description.