Parameter estimation is performed in parallel by distributing training instances asynchronously in each shard and by updating locally copied parameters using the sub-gradients computed from the distributed mini-batches (Dean et al., 2012).
our parser differs in that we do not differentiate left or right head words.