To solve this, instead of reducing the set of available relations, one can increase training data size by using the folding mappings to create new training instances instead of altering existing ones.
given an example A AFTER B one automatically adds an extra B BEFORE A.