In future work, we plan to enrich SentEval with additional tasks as the consensus on the best evaluation for sentence embeddings evolves.
tasks that probe for specific linguistic properties of the sentence embeddings (Shi et al., 2016;Adi et al., 2017) are interesting directions towards understanding how the encoder understands language.