7 Evaluation Following the 2010 i2b2/VA evaluation scheme, we assume that (1) gold concepts and their types are given, and (2) a medical relation classification system is evaluated on all but the "no relation" types.
a system will not be directly rewarded if it correctly identifies a "no relation" instance, but will be penalized if it misclassifies a "no relation" instance as one of the eight relation types.