PBLM is designed to feed structure-aware task classifiers.
in the PBLM-CNN architecture that we consider here (Figure 1b), 4 the PBLM's softmax layer (that computes the probabilities of each pivot to be the next unigram/bigram) is cut and a matrix whose columns are the PBLM's h t vectors is fed to the CNN.