Our approach was also applied in the Spanish STS and Bio-medical STS tasks, where our simple unsupervised approach finished on the top half of the final result list in both cases.
given our results we can safely assume that regardless of the language or the domain cosine similarity using Smooth Inverse Frequency with stacked embeddings of ELMo and BERT will provide a simple but strong unsupervised method for STS tasks.