Such models can also be expected to improve reference resolution: If better predictions can be made about what people will say in a given situation, automatic speech recognition language models can be tighter, NLP grammars can be smaller, and unlikely parses can be avoided, improving both speed and accuracy.
it would be interesting for future work to extend Fruit Carts-style domains to more realistic object construction and placement tasks.