We initialize the model of (6)-(7) so that the estimated directionalityp(→| r, L), regardless of L, is initially a weighted mean of r's directionalities in the training languages, namelȳ where This is done by setting V = 0 and the bias (b V ) r = logp r 1−pr , clipped to the range [−10, 10].
we make sensible initial predictions even for rare relations r, which allows us to converge reasonably quickly even though we do not update the parameters for rare relations as often.