The unmasked BERT embeddings also achieve positively correlated scores, though these correlations are not statistically significant.
m is a d × 2N dimensional matrix, where d is the dimension of the embeddings.