Crowdsourced using Concept-Net (Speer and Havasi, 2012), these questions mostly probe knowledge related to factual and physical commonsense (e.g., "Where would I not want a fox?").
8 In order to ensure even higher quality, we validate the dev and test data a second time with five workers.