Formally, a sequence with f i ∈ F being the nontemporal feature at time i and t i ∈ T as an temporal feature (or we called it positional embedding).
incorporating positional embedding into the attention mechanism may still improve performance.