We also look at ELMo's output when given the entire sentence.
the formula for the compatibility function (and its normalized form e) is defined as follows: Where the bilinear projection φ is defined as: For the composition function a we used either a treeLStM (tai et al., 2015) or a 2-layer MLP (see Appendix A.2 for more precise definitions on both methods).