Although BERT achieves relatively better performance, ALBERT architecture has significantly fewer parameters (18x) and is faster (about 1.7x running time) than BERT.
aL-BERT reduces memory consumption by cross-layer parameter sharing, increases the speed, and obtains a satisfactory performance.