automatic evaluation of machine translation quality using ngram co occurrence statistics
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Machine Translation Quality Using Longest Common Subsequence and Skip-Bigram Statistics" doc
Ngày tải lên :
20/02/2014, 16:20
... Proceedings of
the 2nd International Conference on Language
Resources and Evaluation, Athens, Greece.
NIST. 2002. Automatic Evaluation of Machine
Translation Quality using N-gram Co-
Occurrence Statistics. ... Quantitative Quality Measure for Machine
Translation System. In Proceedings of
COLING-92, Nantes, France.
Thompson, H. S. 1991. Automatic Evaluation of
Translation Quality: Outline of Methodology ... skip-bigrams:
3
Combination: C(4,2) = 4!/(2!*2!) = 6.
Automatic Evaluation of Machine Translation Quality Using Longest Com-
mon Subsequence and Skip-Bigram Statistics
Chin-Yew Lin...
- 8
- 442
- 0
Báo cáo khoa học: "Automatic Construction of Machine Translation Knowledge Using Translation Literalness" docx
Ngày tải lên :
08/03/2014, 21:20
... checks.
These translations are all correct. Actually, the
corpus of Takezawa et al. (2002) contains ten dif-
ferent translations of this source sentence. When
we construct MT knowledge from corpora that
contain ... show
that most context/situation-dependent translations
are non-literal.
MT knowledge constructed from
context/situation-dependent translations cause
incorrect target sentences, which may contain
omissions ... effect of literalness in MT
knowledge construction, we constructed knowl-
edge by using the methods described in Section
5 and evaluated the MT quality of the resulting
English-to-Japanese translation.
6.1...
- 8
- 345
- 0
Báo cáo khoa học: "Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation" pot
Ngày tải lên :
08/03/2014, 04:22
... Corpus BLEU Score
Evaluation Corpus BLEU Score
Number of Rules
Figure 5: Relationship between Number of Itera-
tions and BLEU Scores/Number of Rules
2. Subjective Quality
A total of 510 sentences ... test corpus BLEU score and the subjective
2
In this experiment, it took about 80 hours until convergence
using a Pentium 4 2-GHz computer.
Feedback Cleaning of Machine Translation Rules
Using Automatic ... requires very large corpora in order to obtain a
sufficient number of rules that are statistically confi-
dent.
Another current topic of machine translation is
automatic evaluation of MT quality (Papineni...
- 8
- 313
- 0
Báo cáo khoa học: "Automatic Evaluation of Chinese Translation Output: Word-Level or Character-Level" doc
Ngày tải lên :
17/03/2014, 00:20
... Doddington, 2002. Automatic Evaluation of
Machine Translation Quality Using N-gram Co-
occurrence Statistics. Proceedings of the Second
International Conference on Human Language
Technology ... for Machine Translation Performance.
Proceedings of the Third Workshop on Statistical
Machine Translation, pages 224-232, Columbus,
Ohio, USA.
George Doddington, 2002. Automatic Evaluation of ... Fordyce, Philipp
Koehn, Christof Monz and Josh Schroeder, 2007.
(Meta-) Evaluation of Machine Translation.
Proceedings of the Second Workshop on Statistical
Machine Translation, pages 136-158,...
- 6
- 344
- 1
Báo cáo khoa học: "Automatic Evaluation of Linguistic Quality in Multi-Document Summarization" pptx
Ngày tải lên :
16/03/2014, 23:20
... sentence ordering. In Proceedings
of ACL, pages 545–552.
C.Y. Lin and E. Hovy. 2003. Automatic evaluation of
summaries using n-gram co- occurrence statistics. In
Proceedings of NAACL/HLT, page 78.
C.Y. ... more predictive of
the linguistic quality of these summaries.
7 Conclusion
We have presented an analysis of a wide variety
of features for the linguistic quality of summaries.
Continuity between ... EACL,
pages 148–156.
J.M. Conroy and H.T. Dang. 2008. Mind the gap: dan-
gers of divorcing evaluations of summary content
from linguistic quality. In Proceedings of COLING,
pages 145–152.
S....
- 11
- 407
- 0
Tài liệu Báo cáo khoa học: "Evaluation of Machine Translations by Reading Comprehension Tests and Subjective Judgments" doc
Ngày tải lên :
19/02/2014, 19:20
...
Summary and Conclusions
Evaluation of the quality of machine translations by
means of a test of reading comprehension and by judg-
ments of sentence clarity, was investigated. Human
translations ... necessarily accurate, translations,
EVALUATION OF MACHINE TRANSLATIONS
7
[Mechanical Translation, vol. 8, No. 2, February 1965]
Evaluation of Machine Translations by Reading
Comprehension Tests ... both types of translations, while loss
of context in a paragraph affects only machine trans-
lations, is hardly surprising. The range of values of a
set of stimuli along a judged continuum...
- 7
- 685
- 1
Tài liệu Báo cáo khoa học: "Automatic Evaluation of Sentence-Level Fluency Andrew Mutton∗" pdf
Ngày tải lên :
20/02/2014, 12:20
... characterising an aspect of text quality that
is not related to its content source but to the use of
language itself. It is a goal of this paper to provide
an automatic evaluation method for fluency ... the Role of Bleu in Machine Translation
Research. In Proceedings of EACL, pages 249–256.
Jos´e Coch. 1996. Evaluating and comparing three text-
production strategies. In Proceedings of the 16th ... Evaluation of Ma-
chine Translation. Technical Report RC22176, IBM.
Joseph Turian, Luke Shen, and I. Dan Melamed. 2003. Evalua-
tion of Machine Translation and its evaluation. In Proceedings
of MT...
- 8
- 507
- 0
Tài liệu Báo cáo khoa học: "A Unified Framework for Automatic Evaluation using N-gram Co-Occurrence Statistics" pptx
Ngày tải lên :
20/02/2014, 16:20
... ),(
)(
)(
)(
ferencesRnRSngram
ferencesRnRSngram
clip
ngramCount
ngramCount
nR
where, as before, Count (ngram) is the number of
n-gram counts, and Count
clip
(ngram) is the
maximum number of co- occurrences of ngram ... framework
for automatic evaluation of NLP applications
using N-gram co- occurrence statistics. The
automatic evaluation metrics proposed to date
for Machine Translation and Automatic
Summarization ...
∑∑
∑∑
∈∈
∈∈
=
}{),(
}{),(
)(
)(
)(
CandidatesCnCSngram
CandidatesCnCSngram
clip
ngramCount
ngramCount
nP
where Count (ngram) is the number of n-gram
counts, and Count
clip
(ngram) is the maximum
number of co- occurrences of ngram in the
candidate answer and its...
- 8
- 462
- 0
Tài liệu Báo cáo khoa học: "Computing Consensus Translation from Multiple Machine Translation Systems Using Enhanced Hypotheses Alignment" pot
Ngày tải lên :
22/02/2014, 02:20
... your|$ coffee|coffee or|or $|tea
reordering
I|$ would|would you|you like|like have|$ some|$ coffee|coffee $|or tea|tea
$ would you like $ $ coffee or tea
confusion
$ would you have $ $ coffee ... tea
original
2. would you have tea or coffee
hypotheses
3. would you like your coffee or
4. I have some coffee tea would you like
alignment would|would you|you have|like coffee|coffee or|or tea|tea
and
would|would ... from the union of confu-
35
Table 7: Improvements in translation quality on
the BTEC Italian-English task through comput-
ing consensus translations from the output of two
speech translation systems...
- 8
- 358
- 0
Tài liệu Báo cáo khoa học: "Predicting the fluency of text with shallow structural features: case studies of machine translation and human-written text" doc
Ngày tải lên :
22/02/2014, 02:20
... human and machine translations.
ã Distinguish uent machine translations from
poor machine translations.
ã Distinguish the better (in terms of uency)
translation among two translations of the
same ... done in the
context of machine translation for preliminary in-
vestigations of fluency. Nevertheless, our findings
are also potentially beneficial for sentence-level
evaluation of machine translation.
2 ... and C. Brockett. 2001.
A machine learning approach to the automatic eval-
uation of machine translation. In Proceedings of
39th Annual Meeting of the Association for Compu-
tational Linguistics,...
- 9
- 438
- 0
Báo cáo khoa học: "Cross-Language Document Summarization Based on Machine Translation Quality Prediction" pdf
Ngày tải lên :
07/03/2014, 22:20
...
2.1 Machine Translation Quality Prediction
Machine translation evaluation aims to assess the
correctness and quality of the translation. Usu-
ally, the human reference translation is provided, ... by making use of
both the machine translation quality score and
the informativeness score; 4) The extracted Eng-
lish summary is translated into Chinese summary
by using machine translation ... Section 5.
4 Machine Translation Quality Predic-
tion
4.1 Methodology
In this study, machine translation (MT) quality
reflects both the translation accuracy and the flu-
ency of the translated...
- 10
- 438
- 0
Báo cáo khoa học: " A Tool for Error Analysis of Machine Translation Output" doc
Ngày tải lên :
07/03/2014, 22:20
... Principles of context-based machine translation
evaluation. Machine Translation, 17(1):43–75.
Masaki Murata, Kiyotaka Uchimoto, Qing Ma, Toshiyuki
Kanamaru, and Hitoshi Isahara. 2005. Analysis of
machine ... ref-
erence translation.
1 Introduction
Machine translation evaluation is a difficult task,
since there is not only one correct translation of a
sentence, but many equally good translation options.
Often, ... developers.
2 MT Evaluation and Error Analysis
Hovy et al. (2002) discussed the complexity of MT
evaluation, and stressed the importance of adjusting
evaluation to the purpose and context of the trans-
lation....
- 6
- 479
- 0
Báo cáo khoa học: "Is the Generally Accepted Strategy of Machine-Translation Research Optimal?" ppt
Ngày tải lên :
16/03/2014, 19:20
... extraction of I(T
n
), whereas the
main problem of machine translation is the algorithmiza-
tion of this process of extraction.
The introduction into the theory of translation of this
logical construct—the ... basic conclusion: the
process of human translation (and therefore of analysis
in the course of translation from one natural language
into another, for such translation could be treated as a
combination ...
examination of the process of understanding and, conse-
quently, on an examination of the process of generation
in language communication (e.g., multiple synthesis)
and of translation, that is, of...
- 8
- 379
- 0
Báo cáo khoa học: "Case Revisited: In the Shadow of Automatic Processing of Machine-Readable Dictionaries" ppt
Ngày tải lên :
17/03/2014, 08:20
...
relational concepts (mainly reflected by verbs):
we are trying to get a set of core verbs as proto-
types of classes based on certain statistics and
genus verb sense nets (the latter is being con- ... layer.
3. Dynamic creation of Cases. Initial rep-
resentations in the context layer may be ad-
justed and new Cases be created according to
a set of contextual conditions (mainly when
mismatches ... An Artificial Intelligence Approach
to
Machine Translation, in Computer Models o]
Thoaght 6nd Language, R.Schaak and K.Colby
(eds.), W.H.Freemaa Co. , 1973.
338
...
- 2
- 247
- 0
