Generating gold standard summaries is expensive and time-consuming, a problem that persists with cross-language query biased summarization because those summaries must be query biased as well as in a different language from the source documents.
we have approached cross-language query biased summarization as a stand-alone problem, treating the CLIR system and document retrieval as a black box.