In future work, we will investigate variations of our architecture.
we had initial success sharing the parameters of the two towers which allows training much deeper models without increasing the parameter count.