Initially, given the dataset d 1 , we train the architecture search model to find the best Directed Acyclic Graph (DAG) structure for RNN cell and model parameters θ 1,k under the block sparse condition described above in Sec.
our aim is to find a generalizable cell structure which jointly performs well across different tasks/datasets {d 1 , d 2 , .., d n }.