Here, we use the bi-focal attention mechanism (Nema et al., 2018) via attention parameters W a , W b , and apply it on the hidden layer h t , which embeds information from all previous events in the sequence.
we produce a distribution over the set of possible outcome events V y .