Now, we use Multimodal Factorized Bilinear pooling (MFB) (Yu et al., 2017c) to fuse v t and d t together.
where The function SumPooling(x, k) in (6) means using a onedimensional non-overlapped window with the size k to perform sum pooling over x.