training phrase translation models
Tài liệu Báo cáo khoa học: "Statistical phrase-based models for interactive computer-assisted translation" pdf
Ngày tải lên :
20/02/2014, 12:20
... framework, real-time is re-
quired.
4 Phrase- based models
The usual statistical translation models can be
classified as single-word based alignment models.
Models of this kind assume that an input ... of the target phrases,
a hidden phrase level alignment variable, α
K
1
, is
introduced. In this case, we assume that the target
phrase in position k is produced only by the source
phrase in position ... p(˜s|
˜
t) estimates the probabil-
ity of translating the phrase
˜
t into the phrase ˜s.
A phrase can be comprised of a single word (but
empty phrases are not allowed). Thus, the con-
ventional word...
- 7
- 308
- 0
Tài liệu Báo cáo khoa học: "Effective Phrase Translation Extraction from Alignment Models" ppt
Ngày tải lên :
20/02/2014, 16:20
... maximum
approximation to score candidate translation hy-
potheses. The translation lexicon generated by the
IBM models provides translation estimates at the
word level built on the complete training corpus.
These ... does
not reduce translation quality. Our results corrob-
orate these findings and we use (10) as the phrase
level translation model estimate within our decoder.
6 Integration
Phrase translation pairs ... proportional to the lenth of the phrase,
causing each translation to have a score compara-
ble to the product of the word to word translations
within the phrase.
7 HMM Phrase Extraction
In order to...
- 8
- 323
- 0
Tài liệu Báo cáo khoa học: "Mixing Multiple Translation Models in Statistical Machine Translation" docx
Ngày tải lên :
19/02/2014, 19:20
... heterogeneous
translation systems e.g. phrase- based, hierarchical
phrase- based, and/or syntax-based systems. This
section explains how such models can be combined
during the decoding.
Given a number of translation ... exper-
tise of different models in one single model. The
current implementation is able to combine hierar-
chical phrase- based systems (Chiang, 2005) as well
as phrase- based translation systems (Koehn ... their translations by the IN, OUT and En-
semble models are shown in Figure 2. The boxes
show how the Ensemble model is able to use n-
grams from the IN and OUT models to construct
a better translation...
- 10
- 456
- 0
Tài liệu Báo cáo khoa học: "Incremental Syntactic Language Models for Phrase-based Translation" pptx
Ngày tải lên :
20/02/2014, 04:20
... trans-
lation has effectively used n-gram word sequence
models as language models.
Modern phrase- based translation using large scale
n-gram language models generally performs well
in terms of lexical ... Early work in statisti-
cal phrase- based translation considered whether re-
stricting translation models to use only syntactically
well-formed constituents might improve translation
quality (Koehn ... Syntactic language models
have also been explored with tree-based translation
models. Charniak et al. (2003) use syntactic lan-
guage models to rescore the output of a tree-based
translation system....
- 12
- 510
- 0
Tài liệu Báo cáo khoa học: "Phrase-Based Backoff Models for Machine Translation of Highly Inflected Languages" docx
Ngày tải lên :
22/02/2014, 02:20
... backoff model produced a
good translation, but the translation was a para-
phrase rather than an identical match to the ref-
erence translation. Since only a single reference
translation is available ... adopt a phrase- based
approach such that e is chunked into I phrases
¯e
1
, , ¯e
I
and the translation model is defined
over mappings between phrases in e and in f.
i.e. P (
¯
f |¯e). Typically, phrases ... unknown words dif-
ferently and propose a backoff model for phrase-
based translation.
3 Backoff Models
Generally speaking, backoff models exploit rela-
tionships between more general and more...
- 8
- 379
- 0
Tài liệu Báo cáo khoa học: "Modified Distortion Matrices for Phrase-Based Statistical Machine Translation" doc
Ngày tải lên :
19/02/2014, 19:20
... Rambow. 2011.
Fuzzy syntactic reordering for phrase- based statistical
machine translation. In Proceedings of the Sixth Work-
shop on Statistical Machine Translation, pages 227–
236, Edinburgh, Scotland, ... Arabic-
English statistical machine translation. Machine Trans-
lation, Published Online.
David Chiang. 2005. A hierarchical phrase- based model
for statistical machine translation. In Proceedings of
the ... model for statisti-
cal machine translation. In International Workshop on
Spoken Language Translation (IWSLT), Paris, France.
Kenji Yamada. 2002. A syntax-based translation model.
Ph.D. thesis,...
- 10
- 473
- 0
Tài liệu Báo cáo khoa học: "Topic Models for Dynamic Translation Model Adaptation" pptx
Ngày tải lên :
19/02/2014, 19:20
... in Ta-
ble 2. GTM models the latent topics at the document
level, while LTM models each sentence as a separate
document. To evaluate the effect topic granularity
would have on translation, we varied ... word translation
table p
z
n
(e|f) computed from the training corpus
with the topic distribution p(z
n
|V ) of the test sen-
tence being translated provides a probability on how
relevant that translation ... BLEU and 3 TER on
Chinese to English translation over a strong
baseline.
1 Introduction
The performance of a statistical machine translation
(SMT) system on a translation task depends largely
on...
- 5
- 532
- 0
Tài liệu Báo cáo khoa học: "An Open Source Toolkit for Phrase-based and Syntax-based Machine Translation" docx
Ngày tải lên :
19/02/2014, 20:20
... toolkit for
phrase- based and syntax-based machine translation.
It is implemented in C++ and runs fast. Moreover,
it supports several state-of-the-art models ranging
from phrase- based models to ... toolkit for
phrase- based and syntax-based machine
translation. The toolkit supports several
state-of-the-art models developed in
statistical machine translation, including
the phrase- based ... BLEU4[%] Entry
Dev Test
Moses: phrase 36.51 34.93
Moses: hierarchical phrase 36.65 34.79
phrase 36.99 35.29
hierarchical phrase 37.41 35.35
parsing 36.48 34.71
tree-parsing...
- 6
- 531
- 0
Tài liệu Báo cáo khoa học: "Better Filtration and Augmentation for Hierarchical Phrase-Based Translation Rules" pdf
Ngày tải lên :
20/02/2014, 04:20
... carried out on the NIST
1
Chinese-English translation task with two differ-
ent size of training corpora.
• FBIS: We use the FBIS corpus as the first
training corpus, which contains 239K sen-
tence ... statistical machine translation: pa-
rameter estimation. Comput. Linguist., 19(2):263–
311.
David Chiang. 2005. A hierarchical phrase- based
model for statistical machine translation. In ACL
145
’05: ... evaluate the translation quality us-
ing case-insensitive BLEU metric (Papineni et
al., 2002) without dropping OOV words, and the
feature weights are tuned by minimum error rate
training (Och,...
- 5
- 416
- 0
Tài liệu Báo cáo khoa học: "Phrase-Based Translation Model for Question Retrieval in Community Question Answer Archives" ppt
Ngày tải lên :
20/02/2014, 04:20
... translation model.
3 Our Approach: Phrase- Based
Translation Model for Question
Retrieval
3.1 Phrase- Based Translation Model
Phrase- based machine translation models (Koehn
et al., 2003; D. Chiang, ... this paper, we propose
a novel phrase- based translation model for
question retrieval. Compared to the traditional
word-based translation models, the phrase-
based translation model is more effective ... in modeling the translation of phrases as a
whole. More precise translation can be determined
for phrases than for words. It is thus reasonable to
expect that using such phrase translation probabili-
ties...
- 10
- 440
- 0
- training in statistical machine translation
- applying morphology generation models to machine translation
- towards effective use of training data in statistical machine translation
- incremental training statistical machine translation
- minimum error rate training in statistical machine translation
- models and training for unsupervised prepositional sense disambiguation