Using the triplet loss with memory modules led to greater performance when compared to the attn 3 model, but the performance sits around the use of either triplet only or memory only.
when we increase the N diag to 16 or 32, we find a jump in performance.