Hence, this variant is termed HiGRU-sf, representing HiGRU with selfattention and features fusion.
we apply self-attention upon the forward and backward hidden states separately to produce the left context embedding, h l k (H l j ), and the right context embedding, h r k (H r j ), respectively.