This method assumes that the weight matrices of the bilinear terms are symmetric matrices and thus are diagonalizable.
we can transform the bilinear term of the score functions into a "triple inner product" of two input vectors and a weight vector.