Speedups might of course be gained for all methods by presenting the sentences in batches to the models, by computing sentence representations in parallel and by running code on a GPU.
as we are interested in the differences between the systems, we run the most simple and straightforward scenario.