Ω(b) = k b k log b k , solving the penalized one-hot-argmax has a closed form solution that can be computed using the softmax function (Boyd and Vandenberghe, 2004), that is: .
we replace the non-differentiable one-hot-argmax operation in Algorithm 1 with a softmax in order to build a smooth and fully differentiable surrogate of the parsing algorithm.