Experiments on the development set showed that target word BERT representations and USE sentence embeddings are the best-suited for WiC.
'embedding-based features' here refers to these two representations.