This is different from running a single Map-Reduce job over the entire dataset, since websites in different subsets of the data cannot be matched.
since the data is stored as it is crawled, it is likely that matching websites will be found in the same split of the data.