At each stage of combination, we tried both summing and averaging.
our recent history representations were built by aggregating either word embeddings or SPLex scores, which maintained their dimensionality of 300 or 2, respectively.