We tuned the hyper-parameters and performed early stopping based on question answering accuracy on the validation set.
we considered {50, 100, 200} dimensional representations, λ ∈ {0.1, 1, 10}, retrieving {10, 20} knowledge tuples and {[x -y; x*y], [x, y]} combination functions for during the development of the model.