We already have Z i from running the inside algorithm, and we can find the numerator by running the inside algorithm again with θ scaled by α.
with Rényi entropy, all computations and their gradients are O(n 3 )-even in the nonprojective case.