The state of environment is an important notion in robotic systems as the change of states drives planning for lower-level robotic actions.
connecting language concepts to state changes, our learned AoG provides a unified representation that integrates language and vision to not only support language-based communication but also facilitate robot action planning and execution in the future.