Although such assumptions are common in the model evaluation literature (Reimers and Gurevych, 2018) and for statistical testing in NLP (Dror et al., 2018), they could be problematic for the bounded metrics common in NLP.
we also experimented with modelling the logit transformation of our evaluations, mapping our evaluation metric to the whole real line.