This technique is possible for standard benchmarks but not for large KGs, and we report results in Appendix D for all datasets small enough to allow for full contrastive training.
our main experiments use NLL of sampled softmax since our focus is on scalability.