denotes element-wise product.â is calculated by: where Sigmoid(•) and ReLu(•) represent the element-wise sigmoid and ReLU (Glorot et al., 2011), respectively.
,r We incorporate two separated components,r andĝ, to improve the frequency fitting.