... Dan Melamed.2003. Evaluation of Machine Translation and itsEvaluation. In In Proceedings of MT Summit IX,New Orleans,LA.C. Lin and E. H. Hovy. 200 3a. Automatic Evaluation of Summaries Using ... ORANGE (Lin, 2004), which evaluates a similarity metric using the average ranks obtainedby reference items within a baseline set. As in our framework, ORANGE performs an automaticmeta-evaluation, ... x(m, a) factor in the in- equality) or decreasing the similarity between au-tomatic summaries (the x (a, a ) factor in the in- equality). Finally, adding elements to A can onlyincrease the chances...