... judges
which substitutes for them when there is
need for quick or frequent evaluations.
1
1 Introduction
1.1 Rationale
Human evaluations of machine translation (MT)
weigh many aspects of translation, ... USA
{papineni,roukos,toddward,weijing}@us.ibm.com
Abstract
Human evaluations of machine translation
are extensive but expensive. Human eval-
uations can take months to finish and...
... especially in combination with a part -of-
speech analysis (Popovi
´
c et al., 2006).
Human evaluation is also often quantitative, for
instance in the form of estimates of values such as
adequacy and ... useful for many other MT
researchers and developers.
2 MT Evaluation and Error Analysis
Hovy et al. (2002) discussed the complexity of MT
evaluation, and stressed the importan...
... of the 49th Annual Meeting of the Association for Computational Linguistics, pages 211–219,
Portland, Oregon, June 19-24, 2011.
c
2011 Association for Computational Linguistics
Goodness: A Method ... follow:
P =
the number of correctly tagged labels
the number of tagged labels
R =
the number of correctly tagged labels
the number of reference labels
F =
2*P*R
P+R
(8)
4.2 Con...
...
The results of our evaluation show that the use of
our proposed method as a post-processor for speech
recognition is likely to make a significant contribution
to the performance of speech translation ... value for the frequency
of the occurrence, and 10 as the length of a string,
therefore obtaining 16655 strings.
3.2 Two Factors for Evaluation
We evaluated the fo...
... describes methods for relating (thread-
ing) multiple newspaper articles, and for visualizing
various characteristics of them by using a directed
graph. A set of articles is represented by a set of ...
lem of information overloading, but the articles they
provide do not have links, or else must be manually
linked at a high cost in terms of time and effort.
This paper desc...
... senses of one word
PROCEDURE:
STEP 1. Form a similarity list ]or each sense
of one of the words. Pick one of the words,
say W2, and using WordNet, form a similarity
list for each sense of that ... words. We report
an average accuracy of 80% for the first ranked
sense, and 91% for the first two ranked senses.
Extensions of this method for larger windows of
mor...
... Proceedings of the 12th Conference of the European Chapter of the ACL, pages 799–807,
Athens, Greece, 30 March – 3 April 2009.
c
2009 Association for Computational Linguistics
MINT: A Method for Effective ... ;
1 P
S,T
;
2 for each pair of articles (D
S
, D
T
) in A
S,T
do
3 for each named entity ε
S
in D
S
do
4 Y
S
; // Set of candidates for ε
S
....
... by its set of ver-
tices and its set of edges. Therefore, the domain of
a graph consists of a set of possible vertices, in our
case for the atoms, and possible edges, in our case
for the bonds. ... a crucial role in classifi-
cation of chemical compounds. For example, hy-
droxy, used as a prefix of a name, specifies the
presence of an OH-group (consisting of an oxygen
ato...
...
ferent type of specifications, each of which is
optional except for the name of the exemplar:
• Name: Specification of the name of the ex-
emplar.
• Parameters: Specification of the arguments ...
paragraph-break
( )
object-type
( SSOFT ) :
refl
soft-host
( $SOFT ) : ref2
paragraph-break
( )
soft-usage
( $SOFT ) :
ref3
soft-language
( $SOFT ) :
ref4
]
Rhet:...
... role of multimedia in teaching Natural
Language Processing (NLP) is demonstrated
by constant development of software packages
such as GATE (http://gate.ac.uk) and
NLTK (http://nltk.sourceforge.net/
index.html). ... back-
wards and forwards whenever the user needs it,
Representation Average Result
Definition (formula) 3.5
Picture 2.91
Animation 1 3.64
Animation 2 2.09
Animation 3 2.45
Table...