PBLM can naturally feed a structure-aware task classifier.
in the PBLM-CNN ar- chitecture that we consider here (Figure 2b), 2 the PBLM's softmax layer (that computes the probabilities of each pivot to be the next unigram/bigram) is cut and a matrix whose columns are the PBLM's h t vectors is fed to the CNN.