The intuition is that, if the context is less relevant, we should mainly focus on the query itself, but if the context is relevant, we should focus more evenly across context and the query.
our explicitly weighting approach could be viewed as heuristic attention.