For the first requirement, we could incorporate a "temperature" parameter in the softmax to push for more peaked distributions.
this does not guarantee sparsity (only "hard attention" in the limit) and we found it numerically unstable when plugged in Alg.