For the other parameters in Θ and Θ , we adopt the settings reported by Nguyen and Grishman (2015).
the non-linear transformation function g is tanh, the mini-batch size is 50, the dropout rate α equals 0.5, and the hyperparameter for the l 2 norms is set to be 3.