So we haveX This is similar to a standard attention mechanism, where attended representation is computed by summing the scaled representations.
such scaled addition is not possible when the outputs from lower layers are not of the same shapes, as in the following case.