... what was supposed to be a fantasy sports car ride at @entity3 turned deadly when a @entity4 crashed into a guardrail .
this way we model probability s i that the answer to query q appears at position i in the document d. In a functional form this is: Finally we compute the probability that word w is a correct answer as: where ) is a set of positions where w appears in the document d. We call this mechanism pointer sum attention since we use attention as a pointer over discrete tokens in the context document and then we directly sum the word's attention across all the occurrences.