On In-suranceQA, this strategy alone improves over previously reported results by a minimum of 1.6 points in P@1.
we used Max-Pooling and Max-Min-Pooling, the latter being obtained by concatenating the outputs of Max and Min Pooling.