automatic evaluation of machine translation quality using ngram cooccurrence statistics
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics" doc
Ngày tải lên :
20/02/2014, 16:20
... Proceedings of
the 2nd International Conference on Language
Resources and Evaluation, Athens, Greece.
NIST. 2002. Automatic Evaluation of Machine
Translation Quality using N-gram Co-
Occurrence Statistics. ... Quantitative Quality Measure for Machine
Translation System. In Proceedings of
COLING-92, Nantes, France.
Thompson, H. S. 1991. Automatic Evaluation of
Translation Quality: Outline of Methodology ...
3
Combination: C(4,2) = 4!/(2!*2!) = 6.
Automatic Evaluation of Machine Translation Quality Using Longest Com-
mon Subsequence and Skip-Bigram Statistics
Chin-Yew Lin and Franz Josef Och...
- 8
- 442
- 0
Báo cáo khoa học: "Automatic Construction of Machine Translation Knowledge Using Translation Literalness" docx
Ngày tải lên :
08/03/2014, 21:20
... objective translations
for the rule writer. Therefore, the rewritten translations were
acquired by translating trained sentences by TDMT.
157
Automatic Construction of Machine Translation Knowledge
Using ... words in the target language
and the mean number of translation words, both
values of the rewritten translations are lower than
those of the original translations. This is because
1
When TDMT translates ... trans./word
4.21
Rewritten Translations
Original Translations
Table 1: Comparison of TDMT Training Translations and Original Translations
the rule writers rewrote translations to make tar-
get...
- 8
- 345
- 0
Báo cáo khoa học: "Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation" pot
Ngày tải lên :
08/03/2014, 04:22
... MT quality would
certainly improve further.
7 Discussion
7.1 Other Automatic Evaluation Methods
The idea of feedback cleaning is independent of
BLEU. Some automatic evaluation methods of MT
quality ... Yanagida. 2001. An au-
tomatic evaluation method of translation quality using
translation answer candidates queried from a parallel
corpus. In Proceedings of Machine Translation Sum-
mit VIII, pages ... current topic of machine translation is
automatic evaluation of MT quality (Papineni et al.,
2002; Yasuda et al., 2001; Akiba et al., 2001). These
methods aim to replace subjective evaluation in...
- 8
- 313
- 0
Báo cáo khoa học: "Automatic Evaluation of Chinese Translation Output: Word-Level or Character-Level" doc
Ngày tải lên :
17/03/2014, 00:20
... essential
for automatic evaluation of Chinese translation
output. Our analysis suggests several key reasons
behind this finding.
2 Chinese Translation Evaluation
Automatic MT evaluation aims ... Fordyce, Philipp
Koehn, Christof Monz and Josh Schroeder, 2007.
(Meta-) Evaluation of Machine Translation.
Proceedings of the Second Workshop on Statistical
Machine Translation, pages 136-158, ... for Machine Translation Performance.
Proceedings of the Third Workshop on Statistical
Machine Translation, pages 224-232, Columbus,
Ohio, USA.
George Doddington, 2002. Automatic Evaluation of...
- 6
- 344
- 1
Báo cáo khoa học: "Automatic Evaluation of Linguistic Quality in Multi-Document Summarization" pptx
Ngày tải lên :
16/03/2014, 23:20
... year
of evaluation to the next.
5.2 Evaluation of rankings
We examine the predictive power of our features
for each of the five linguistic quality questions in
two settings. In system-level evaluation, ... sentence ordering. In Proceedings
of ACL, pages 545–552.
C.Y. Lin and E. Hovy. 2003. Automatic evaluation of
summaries using n-gram co-occurrence statistics. In
Proceedings of NAACL/HLT, page 78.
C.Y. ... of systems,
ignoring the linguistic quality of the system out-
put. Part of the reason for this imbalance is the
existence of ROUGE (Lin and Hovy, 2003; Lin,
2004), the system for automatic evaluation...
- 11
- 407
- 0
Tài liệu Báo cáo khoa học: "Evaluation of Machine Translations by Reading Comprehension Tests and Subjective Judgments" doc
Ngày tải lên :
19/02/2014, 19:20
... though not necessarily accurate, translations,
EVALUATION OF MACHINE TRANSLATIONS
7
[Mechanical Translation, vol. 8, No. 2, February 1965]
Evaluation of Machine Translations by Reading
Comprehension ... judgments of the clarity of meaning of indivi-
dual sentences. The approach through testing of reading
comprehension provides a direct test of at least one
aspect of the quality of translation. ... combination
of several methods, including the two investigated here,
would appear likely to be of some use.
Summary and Conclusions
Evaluation of the quality of machine translations by
means of a...
- 7
- 685
- 1
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Sentence-Level Fluency Andrew Mutton∗" pdf
Ngày tải lên :
20/02/2014, 12:20
... Evaluation of Ma-
chine Translation. Technical Report RC22176, IBM.
Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua-
tion of Machine Translation and its evaluation. In Proceedings
of MT ... characterising an aspect of text quality that
is not related to its content source but to the use of
language itself. It is a goal of this paper to provide
an automatic evaluation method for fluency ... grammar, rhythm and flow,
appropriateness of tone, and several other specific
characteristics of good text.
In terms of automatic evaluation, we are not aware
of any technique that measures only fluency...
- 8
- 507
- 0
Tài liệu Báo cáo khoa học: "Computing Consensus Translation from Multiple Machine Translation Systems Using Enhanced Hypotheses Alignment" pot
Ngày tải lên :
22/02/2014, 02:20
... system translation in terms of all error mea-
sures.
We also checked how many sentences in the
consensus translation of the test corpus are differ-
ent from the 5 original translations. 185 out of ... uniform
probability distribution – it is necessary to penal-
ize translations of low quality.
3.4 Spanish-English Translation
The improvements in translation quality are
also significant on the TC-STAR EPPS Spanish-
English ... your|$ coffee|coffee or|or $|tea
reordering
I|$ would|would you|you like|like have|$ some|$ coffee|coffee $|or tea|tea
$ would you like $ $ coffee or tea
confusion
$ would you have $ $ coffee or...
- 8
- 358
- 0
Tài liệu Báo cáo khoa học: "Predicting the fluency of text with shallow structural features: case studies of machine translation and human-written text" doc
Ngày tải lên :
22/02/2014, 02:20
... human and machine translations.
ã Distinguish uent machine translations from
poor machine translations.
ã Distinguish the better (in terms of uency)
translation among two translations of the
same ... Proceedings of HLT/NAACL’04.
S. Corston-Oliver, M. Gamon, and C. Brockett. 2001.
A machine learning approach to the automatic eval-
uation of machine translation. In Proceedings of
39th Annual Meeting of ... in the
context of machine translation for preliminary in-
vestigations of fluency. Nevertheless, our findings
are also potentially beneficial for sentence-level
evaluation of machine translation.
2...
- 9
- 438
- 0
Báo cáo khoa học: "Cross-Language Document Summarization Based on Machine Translation Quality Prediction" pdf
Ngày tải lên :
07/03/2014, 22:20
... language to the target language
by using machine translation services. However,
though machine translation techniques have been
advanced a lot, the machine translation quality is
far from satisfactory, ... evaluation results will be described together
in Section 5.
4 Machine Translation Quality Predic-
tion
4.1 Methodology
In this study, machine translation (MT) quality
reflects both the translation ...
2.1 Machine Translation Quality Prediction
Machine translation evaluation aims to assess the
correctness and quality of the translation. Usu-
ally, the human reference translation is provided,...
- 10
- 438
- 0
Báo cáo khoa học: " A Tool for Error Analysis of Machine Translation Output" doc
Ngày tải lên :
07/03/2014, 22:20
... Principles of context-based machine translation
evaluation. Machine Translation, 17(1):43–75.
Masaki Murata, Kiyotaka Uchimoto, Qing Ma, Toshiyuki
Kanamaru, and Hitoshi Isahara. 2005. Analysis of
machine ... ref-
erence translation.
1 Introduction
Machine translation evaluation is a difficult task,
since there is not only one correct translation of a
sentence, but many equally good translation options.
Often, ... highlights parts of the MT
output that it suspects are non-grammatical.
Even though the main purpose of BLAST is for
error annotation of machine translation output, the
freedom in the use of error typologies...
- 6
- 479
- 0
Báo cáo khoa học: "Is the Generally Accepted Strategy of Machine-Translation Research Optimal?" ppt
Ngày tải lên :
16/03/2014, 19:20
... I(T
n
), whereas the
main problem of machine translation is the algorithmiza-
tion of this process of extraction.
The introduction into the theory of translation of this
logical construct—the ...
process of human translation (and therefore of analysis
in the course of translation from one natural language
into another, for such translation could be treated as a
combination of successive translations ... extent of the
knowledge of language in general which is necessary
from the point of view of theoretical linguistics with the
extent of knowledge of language necessary for the
achievement of translation...
- 8
- 379
- 0
Báo cáo khoa học: "Case Revisited: In the Shadow of Automatic Processing of Machine-Readable Dictionaries" ppt
Ngày tải lên :
17/03/2014, 08:20
... trying to get a set of core verbs as proto-
types of classes based on certain statistics and
genus verb sense nets (the latter is being con-
structed by G. Stein). A primary set of core
verbs ... word list of LDOCE, then gradually ex-
panding them to all the verbs defined in
LDOCE.
There are various subtasks associated with
this work:
1. Dynamically adjusting classifications of
relational ... endurance. An
example of an initial representation for
break
is: ((+) (u-) (0)) break ((-) (u-) (0)), where
(+) stands for active, (-) for passive, (u -) for
indexing of the internal environment,...
- 2
- 247
- 0
