A few variations to this additive attention mechanism have been proposed, such as multiplicative and self-attention (Luong et al., 2015; Cheng et al., 2016; Lin et al., 2017).
numerical values can be represented using fewer bits (Tang and Kwan, 1993; Marchesi et al., 1993).