In this section, we will introduce a new method for amortizing inference costs over time.
the key observation that leads to this theorem stems from the structured margin δ for an inference problem p ∼ [P ], which is defined as follows: for all feasible y, we have c t p y p ≥ c t p y + δ.