We investigate embeddings by probing: Is the information we care about available in a word w's embedding?
we probe for S-classes: Can the information whether w belongs to a specific S-class be obtained from its embedding?