... Computa-tional Linguistics.C. Lin. 2004. Orange: a Method for Evaluating Au-tomatic Metrics for Machine Translation. In Pro-ceedings of the 36th Annual Conference on Compu-tational Linguisticsion ... may changeby adding, for instance, additional gold standards? In this paper, we introduce a probabilistic framework, QARLA, that addresses such issues.Given a set of manual summaries and another ... between au-tomatic summaries (the x (a, a ) factor in the in- equality). Finally, adding elements to A can onlyincrease the chances of finding a pair of automaticsummaries satisfying the condition...