In replicating Hopkins and May's experiments, we confirm that existing search algorithms for MERT-including coordinate ascent, Powell's algorithm (Powell, 1964), and random direction sets (Cer et al., 2008)-perform poorly in this experimental condition.
when using our gradient-based direction finder, MERT has no problem finding the true optimum even in a 1000-dimensional space.