RECL is defined on a model group instead of a single model, and the gain of a long context is measure by the relative improvement over the best short context model.
for completeness, we summarize the computational procedure for a N -layer Transformer-XL with a single attention head here.