We could estimate these by sampling t from the token encoder p ✓ (t | x) and then evaluating all q , p ✓ , r , and s ⇠ probabilities.
in fact we use the sampled t only to estimate the first expectation (by computing the decoder probability q (y | t) of the gold tree y); we can compute the KL terms exactly by exploiting the structure of our distributions.