(2016) also show that resulting models seem to exhibit some degree of zero-shot generalization enabled by parameter sharing.
since we lack data for zero-shot directions, composite likelihood (3) misses the terms that correspond to the zero-shot models, and hence has no statistical guarantees for performance on zero-shot tasks.