Most prominently, CLUTRR allows us to explicitly evaluate a model's ability for systematic generalization.
we rely on the following hold-out procedures to test systematic generalization: • During training, we hold out a subset of the collected paraphrases, and we only use this held-out subset of paraphrases when generating the test set.