The state representation of the entire tree consists of all word states: In order to capture non-local interactions between words, the GRN layer adopts a message passing framework that performs iterative information exchange between directly connected words.
for the other hyper-parameters, word embeddings are initialized with the 200-dimensional BioASQ vectors 5 , pretrained on 10M abstracts of biomedical articles, and are fixed during training.