We combine EventTransE with the ELMo baseline by having another attention layer on top of the event embeddings and concatenating all the argument  representations in the network.
events appearing in similar contexts tend to have similar representations.