For the navigation task, we use the MARCO (MacMahon et al., 2006) execution module, which is also used to evaluate how well the overall system learns to follow directions (Chen and Mooney, 2011).
we modify it to rerank the parse trees generated by Kim and Mooney (2012)'s model.