It is observed that for the encoder networks, increasing the non-linearity by stacking MLP layers leads to better empirical results.
endowing the hash function with more modeling capacity is advantageous to retrieval tasks.