Gutmann and Hyvarinen (2012) proved that S(m) ≤ S(pce) for every matrix m. The rank of the matrix m is at most d + 1.
the NCE training goal is finding the best low-rank decomposition of the PCE matrix in the sense that it minimizes the difference S(pce) − S(m).