Modules: As shown in the 6th to 8th row, removing either the Compare, Relocate or NoOp module also causes drops in the metric scores.
removing the Relocate module causes significant degrade in bridge-type questions, which solidifies our claim that relocating the attention based on the inferred bridge entity is important for compositional reasoning.