The corpora that were collected and the annotated gold standards are available at http://www.cs.cmu.edu/~lingwang/microtopia/.
this operation is only expensive if we compute the translation score, as the span and language scores can be more efficiently computed.