In fact, it is the only component of the loss function which attempts to learn these relationships.
decreasing it's importance (by increasing the value of α) is reflected by a decay in the semantic analogies score.