We perform a subsequent run of ASP-GCN on the same sentence s to extract a final embedding, but in this instance we conceal a specific input word w. We conceal w by mapping it to the zero vector before applying ASP-GCN on s. As a result a final embedding h (s\w) is generated for s. If h s = h (s\w) , the word w has no impact on the representation h s .
h s does not capture w or no information flows from w to h s .