The key to a more efficient solution is to note that θ(µ) is invariant to scaling of µ.
we can store S = instead of µ and make the following sparse update: For both iEM and sEM, we also need to efficiently compute θ(µ).