When focusing on the neural pipeline approaches, we found that in all the steps up to Text Structuring, the recurrent networks retained more information than the Transformer.
68% of the Transformer's text trials contained all the input triples, against 67% of the GRU's trials.