To reduce model complexity, we replace the fully-connected structure with a star-shaped topology, in which every two non-adjacent nodes are connected through a shared relay node.
the maximum dependency path length of Star-transformer is O(1) with a constant two via the relay node.