In this paper, we argue that amid this rapid progress on empirical benchmarks, crucial steps are sometimes skipped.
we demonstrate that the level of difficulty for several of these tasks is poorly characterized.