The radical connections focus on the non-local compositions and the ring connections focus on the local composition.
star-Transformer works for modestly sized datasets and does not rely on heavy pre-training.