The second drawback of the global approach has been alleviated through approximate optimization techniques, such as PageRank/random walks (Pershina et al., 2015), graph pruning (Hoffart et al., 2011), ranking SVMs (Ratinov et al., 2011), or loopy belief propagation (LBP) (Globerson et al., 2016;Ganea and Hofmann, 2017).
these methods are not differentiable and thus difficult to be integrated into neural network models (the solution for the first limitation).