For the DNN models, we add the penalty term λ θ 2 to the losses, where λ is the regularization coefficient and θ contains all other parameters.
for the bilinear models we regularize the relation matrices M R toward the identity matrix instead of all zeroes, adding the following to the loss: where I r is the r × r identity matrix, the summation is performed over all relations R, and θ represents all other parameters.