Due to limited computational resources, we determine the range of hyper-parameters to consider based on pilot experiments and domain insights.
we evaluate l d ∈ [256,384,512,640,768], n s ∈ [1, 2, 3, 4], and l g ∈ [2, 3, 4].