The TNet variants can still outperform LSTM-FC-CNN-LF/AS with significant gaps, e.g., on LAPTOP and REST, the accuracy gaps between TNet-LF and LSTM-FC-CNN-LF are 0.42% (p < 0.03) and 0.38% (p < 0.04) respectively.
as our TNet involves multiple CPT layers, we investigate the effect of the layer number L. we conduct experiments on the held-out training data of LaPTOP and vary L from 2 to 10, increased by 2.