The number of clusters (i.e., the number of paraphrase sets in a set of an image and captions) is not explicitly given in our task.
we apply the affinity propagation algorithm (Frey and Dueck, 2007) to cluster entities, which can estimate the number of clusters as well.