In contrast, our third system employs patterns that are hand-crafted based on manual observations made on the training set.
we ask a human to identify the contexts of two concepts that are strongly indicative of a relation class.