We finally build a stacked bimodal autoencoder (SAE) with all pre-trained layers and fine-tune them with respect to a semi-supervised criterion.
we unfold the stacked autoencoder and furthermore add a softmax output layer on top of the bimodal layery that outputs predictionst with respect to the inputs' object labels (e.g., boat): with weights W (6) ∈ R O×B , b (6) ∈ R O×1 , where O is the number of unique object labels.