Our beam-joint also is a mixture of softmax and possibly achieves higher rank than a single softmax.
their mixture requires learning multiple softmax matrices, whereas ours are due to varying attention and we do not learn any extra parameters than soft attention.