Thus we focus on the numerator term By the product rule, its gradient with respect to q is a sum of two terms.
x N ), it assumes a uniform distribution over consecutive word pairs (x i−1 , x i ) and optimizes the following empirical objective where #(c, c ) denotes the number of occurrences of the cluster pair (c, c ) under C. While this optimization is intractable, Brown et al.