Here, H(p, q) is the cross entropy between p and q, andp(t j |v i , L i ) is the soft supervision distribu-tion.
it is defined as: is the boolean function of checking whether the i-th span candidate is labeled as the type t j in the distant supervision.