We initialize all parameters in s d to 0, set the learning rate for the stochastic optimizer to 0.001.
among them, (Liu et al., 2010) proposed to use phrase and rule pairs to model the context information in a loglinear framework.