discriminative n gram language modeling for turkish
Tài liệu Báo cáo khoa học: "Improved Smoothing for N-gram Language Models Based on Ordinary Counts" doc
Ngày tải lên :
20/02/2014, 09:20
... is a single unknown probability distribution
for the amount of quantization error in every N-
gram count. If so, the total quantization error for
a given context will tend to be proportional to ... new method eliminating
most of the gap between Kneser-Ney and
those methods.
1 Introduction
Statistical language models are potentially useful
for any language technology task that produces
natural -language ... currently be the best approach when language
models based on ordinary counts are desired.
References
Chen, Stanley F., and Joshua Goodman. 1998.
An empirical study of smoothing techniques for
language...
- 4
- 365
- 0
Tài liệu Báo cáo khoa học: "Discriminative Syntactic Language Modeling for Speech Recognition" pdf
Ngày tải lên :
20/02/2014, 15:20
... University.
http://arXiv.org/abs/cs/0105019.
Ronald Rosenfeld, Stanley Chen, and Xiaojin Zhu. 2001.
Whole-sentence exponential language models: a vehicle for
linguistic-statistical integration. In Computer Speech and
Language.
Fei Sha and ... modeling. In Proceedings of the
36th Annual Meeting of the Association for Computational
Linguistics and 17th International Conference on Computa-
tional Linguistics, pages 225–231.
Ciprian Chelba ... Fernando Pereira. 2003. Shallow parsing with
conditional random fields. In Proceedings of the Human
Language Technology Conference and Meeting of the North
American Chapter of the Association for...
- 8
- 409
- 0
Tài liệu Báo cáo khoa học: "A Succinct N-gram Language Model" ppt
Ngày tải lên :
20/02/2014, 09:20
... lossy
representation (Talbot and Brants, 2008).
2 N -gram Language Model
We assume a back-off N- gram language model in
which the conditional probability Pr(w
n
|w
n 1
1
)
for an arbitrary N- gram w
n
1
=(w
1
, ... the
highest order N- grams is 1.2G.
We implemented an N- gram indexer/estimator
using MPI inspired by the MapReduce imple-
mentation of N -gram language model index-
ing/estimation pipeline (Brants et al., ... Compressing
trigram language models with Golomb coding. In
Proc. of EMNLP-CoNLL 2007.
O. Delpratt, N. Rahman, and R. Raman. 2006. Engi-
neering the LOUDS succinct tree representation. In
Proc....
- 4
- 457
- 0
Báo cáo khoa học: "Faster and Smaller N -Gram Language Models" pptx
Ngày tải lên :
07/03/2014, 22:20
... number of keys and values needed for n- gram
language modeling, generic implementations do not
work efficiently “out of the box.” In this section,
we will review existing techniques for encoding ... Each
node in the tree encodes a word, and paths in the
tree correspond to n- grams in the collection. Tries
ensure that each n- gram prefix is represented only
once, and are very efficient when n- grams ... scalable
decoder for parsing-based machine translation with
equivalent language model state maintenance. In Pro-
ceedings of the Second Workshop on Syntax and Struc-
ture in Statistical Translation.
Zhifei...
- 10
- 463
- 0
Báo cáo khoa học: "Discriminative Feature-Tied Mixture Modeling for Statistical Machine Translation" pdf
Ngày tải lên :
17/03/2014, 00:20
... Measuring con-
fidence intervals for the machine translation evalua-
tion metrics. In Proceedings of The 10th International
Conference on Theoretical and Methodological Issues
in Machine Translation.
Bing ... Machine Intelli-
gence.
George Foster, Cyril Goutte, and Roland Kuhn. 2010.
Discriminative instance weighting for domain adapta-
tion in satistical machine translation. In Proceedings
of EMNLP.
Abraham ... translation performance significantly on a
large-scale Arabic-to-English MT task.
1 Introduction
Significant progress has been made in statisti-
cal machine translation (SMT) in recent years.
Among...
- 5
- 259
- 0
Báo cáo khoa học: "Grounded Language Modeling for Automatic Speech Recognition of Sports Video" doc
Ngày tải lên :
17/03/2014, 02:20
... grounded
language modeling, an extension of tradition lan-
guage modeling in which the probability of a word
is conditioned not only on the previous word(s) but
also on the non-linguistic context ... grounded language models. Estimating
bigram and trigram models can be done by processing on
word pairs or triples, and performing normalization on the
resulting conditional distributions. ... In-
ternational Conference on Knowledge Discovery and
Data Mining. Seattle, Washington.
Stolcke, A., (2002). SRILM - An Extensible Language
Modeling Toolkit, in Proc. Intl. Conf. Spoken Lan-
guage...
- 9
- 395
- 0
Báo cáo khoa học: "Discriminative Pruning of Language Models for Chinese Word Segmentation" ppt
Ngày tải lên :
17/03/2014, 04:20
... Association for Computational Linguistics
Discriminative Pruning of Language Models for
Chinese Word Segmentation
Jianfeng Li Haifeng Wang Dengjun Ren Guohua Li
Toshiba (China) Research and Development ... Jiang,
and Chin-Hui Lee. 2002. Discriminative Training
of Language Models for Speech Recognition. In
Proc. of the 27
th
International Conference On
Acoustics, Speech and Signal Processing ... P(S|W). In
language model pruning, Λ is an invariable.
The discriminative pruning criterion is in-
spired by the comparison of segmented sentences
using full-bigram model Г
F
and using base...
- 8
- 294
- 0
Tài liệu Báo cáo khoa học: "Discriminative Lexicon Adaptation for Improved Character Accuracy – A New Direction in Chinese Language Modeling" pptx
Ngày tải lên :
20/02/2014, 07:20
... statis-
tical language modeling for Chinese. ACM Trans-
action on Asian Language Information Processing,
1(1):3–33.
Jianfeng Gao, Mu Li, Andi Wu, and Chang-Ning
Huang. 2004. Chinese word segmentation: A ... characters in the lexi-
con and using the training data to alter the current
lexicon in each iteration. This is also an interesting
direction.
References
Maximilian Bisani and Hermann Ney. 2005. Open vo-
cabulary ... recognition with flat hybrid models.
In Interspeech, pages 725–728.
Keh-Jiann Chen and Wei-Yun Ma. 2002. Unknown
word extraction for chinese documents. In COLING,
pages 169–175.
Berlin Chen, Jen-Wei...
- 9
- 466
- 0
Tài liệu Báo cáo khoa học: "An ERP-based Brain-Computer Interface for text entry using Rapid Serial Visual Presentation and Language Modeling" ppt
Ngày tải lên :
20/02/2014, 05:20
... removed and, like before, the
user can take a break and then the system continues
with the next epoch.
3 Language Modeling
Language modeling is important for many text pro-
cessing applications, e.g., ... Fried-Oken.
2010. Scanning methods and language modeling for
binary switch typing. In Proceedings of the NAACL
HLT 2010 Workshop on Speech and Language Pro-
cessing for Assistive Technologies, pages ... history is ob-
tained from the language model. Seventh, Bayesian
fusion (which assumes the EEG-based information
and the language model information are statistically
independent given the class label)...
- 6
- 551
- 0
Tài liệu Báo cáo khoa học: "Source-Language Entailment Modeling for Translating Unknown Terms" ppt
Ngày tải lên :
20/02/2014, 07:20
... table entries) for the unknown terms
when using synonyms, and 1,643 when using both
synonyms and hypernyms, accounting for 43%
and 66% of the test sentences, respectively.
The number of alternative ... sin-
gle unknown term often affects the translation of
wider portions of text, inducing errors in both lex-
ical selection and ordering. This phenomenon is
demonstrated in the following sentences, ... hypernyms, which typically
conform with entailment. We do not rely on sense
information in WordNet. Hence, any other seman-
tic resource for entailment rules can be utilized.
Each sentence is...
- 9
- 330
- 0
Tài liệu Báo cáo khoa học: "A Unified Framework for Automatic Evaluation using N-gram Co-Occurrence Statistics" pptx
Ngày tải lên :
20/02/2014, 16:20
...
∑∑
∑∑
∈∈
∈∈
=
}{),(
}{),(
)(
)(
)(
CandidatesCnCSngram
CandidatesCnCSngram
clip
ngramCount
ngramCount
nP
where Count(ngram) is the number of n- gram
counts, and Count
clip
(ngram) is the maximum
number of co-occurrences of ngram ... ),(
)(
)(
)(
ferencesRnRSngram
ferencesRnRSngram
clip
ngramCount
ngramCount
nR
where, as before, Count(ngram) is the number of
n- gram counts, and Count
clip
(ngram) is the
maximum number of co-occurrences of ngram in
the reference answer and its corresponding ... using ST and eliminating
the unigrams found in SW. We therefore define a
recall score as:
∑∑
∑
∑
∈∈
∈∈
=
}{Re ),(
}{Re ),(
)(
)(
)(
ferencesRnRSngram
ferencesRnRSngram
clip
ngramCount
ngramCount
nR
...
- 8
- 462
- 0
Báo cáo khoa học: "A Scalable Probabilistic Classifier for Language Modeling" pdf
Ngày tải lên :
07/03/2014, 22:20
... Proceedings of the 5th International Con-
ference on Spoken Language Processing, pages 1694–
1698, Sydney, Australia.
R. Kneser and H. Ney. 1995. Improved Backing-off
for M -Gram Language Modeling. In ... 2002. SRILM – An Extensible Language
Modeling Toolkit. In Proceedings of the 7th Inter-
national Conference on Spoken Language Processing,
pages 901–904, Denver, CO, USA.
A. Van den Bosch. 2005. Scalable ... of
the information contained in the conditioning con-
text, as indicated by the fact that VM-SR matches
KN whereas VM-BA doesn’t. At orders 4 and 5,
VM-LR outperforms KN on all datasets, bringing
improvements...
- 6
- 350
- 0
Báo cáo khoa học: "An Efficient Indexer for Large N-Gram Corpora" docx
Ngày tải lên :
07/03/2014, 22:20
... Melbourne, Australia.
R. Kneser and H. Ney. 1995. Improved backing-off for
n- gram language modeling. In Acoustics, Speech, and
Signal Processing, 1995. ICASSP-95., 1995 Interna-
tional Conference on, ... Efficient Indexer for Large N- Gram Corpora
Hakan Ceylan
Department of Computer Science
University of North Texas
Denton, TX 76203
hakan@unt.edu
Rada Mihalcea
Department of Computer Science
University ... definition, each
internal node except the root can have any number of
keys in the range [v, 2v], and the root must have at
least one key. Finally, an internal node with k keys
has k + 1 children.
4.2...
- 6
- 320
- 0
Báo cáo khoa học: "Fast Syntactic Analysis for Statistical Language Modeling via Substructure Sharing and Uptraining" ppt
Ngày tải lên :
16/03/2014, 19:20
... integrated syntactic language modeling.
Ph.D. thesis, Brown University.
L. Huang and K. Sagae. 2010. Dynamic Programming
for Linear-Time Incremental Parsing. In Proceedings
of ACL.
Zhongqiang ... Discrimina-
tive syntactic language modeling for speech recogni-
tion. In ACL.
Denis Filimonov and Mary Harper. 2009. A joint
language model with fine-grain syntactic tags. In
EMNLP.
Yoav Goldberg and Michael ... entropy tech-
niques for exploiting syntactic, semantic and colloca-
tional dependencies in language modeling. Computer
Speech and Language, pages 355–372.
S. K
¨
ubler, R. McDonald, and J. Nivre. 2009....
- 9
- 319
- 0
Báo cáo khoa học: "Approximation Lasso Methods for Language Modeling" doc
Ngày tải lên :
17/03/2014, 04:20
...
Exploiting headword dependency and predictive
clustering for language modeling. In EMNLP 2002.
Gao. J., Yu, H., Yuan, W., and Xu, P. 2005. Minimum
sample risk methods for language modeling. In
HLT/EMNLP ... models. In the first column, the
numbers in parentheses next to the domain name
indicates the number of training sentences used
for adaptation.
Baseline, with results shown in Column 3, is ... containing
newspapers and other sources of text), Encarta
(encyclopedia) and Shincho (collection of novels).
All corpora have been pre-word-segmented us-
ing a lexicon containing 167,107 entries....
- 8
- 313
- 0
