Drawing inspiration from recent efforts to empower neural networks with a structural bias (Cheng et al., 2016; Kim et al., 2017), we propose a model that can encode a document while automatically inducing rich structural dependencies.
we embed a differentiable non-projective parsing algorithm into a neural model and use attention mechanisms to incorporate the structural biases.