joint chinese word segmentation pos tagging and parsing
Báo cáo khoa học: "Incremental Joint Approach to Word Segmentation, POS Tagging, and Dependency Parsing in Chinese" potx
Ngày tải lên :
07/03/2014, 18:20
... sequence of POS
tags. The joint approach to word segmentation and
POS tagging has been reported to improve word seg-
mentation and POS tagging accuracies by more than
1% in Chinese (Zhang and Clark, ... jtsujii@microsoft.com
Abstract
We propose the first joint model for word segmen-
tation, POS tagging, and dependency parsing for
Chinese. Based on an extension of the incremental
joint model for POS tagging and dependency ... the top word on the stack if the last action was A or SH(t).
1048
interaction between segmentation and POS tagging.
3 Model
3.1 Incremental Joint Segmentation, POS
Tagging, and Dependency Parsing
Based...
- 9
- 523
- 0
Báo cáo khoa học: "An Error-Driven Word-Character Hybrid Model for Joint Chinese Word Segmentation and POS Tagging" docx
Ngày tải lên :
17/03/2014, 01:20
... model for joint chinese
word segmentation and part-of-speech tagging. In
Proceedings of ACL.
Wenbin Jiang, Haitao Mi, and Qun Liu. 2008b. Word
lattice reranking for chinese word segmentation and
part-of-speech ... ACL and AFNLP
An Error-Driven Word- Character Hybrid Model
for Joint Chinese Word Segmentation and POS Tagging
Canasai Kruengkrai
†‡
and Kiyotaka Uchimoto
‡
and Jun’ichi Kazama
‡
Yiou Wang
‡
and ... discriminative
word- character hybrid model for joint Chi-
nese word segmentation and POS tagging.
Our word- character hybrid model offers
high performance since it can handle both
known and unknown words....
- 9
- 338
- 0
Báo cáo khoa học: "A Cascaded Linear Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging" pdf
Ngày tải lên :
08/03/2014, 01:20
... segmentation and POS tagging task
is to divide a character sequence into several subse-
quences and label each of them a POS tag.
It is a better idea to perform segmentation and
POS tagging jointly ... and joint segmentation and
part-of-speech tagging. On the Penn Chinese
Treebank 5.0, we obtain an error reduction of
18.5% on segmentation and 12% on joint seg-
mentation and part-of-speech tagging ... each word- POS pair p (of length l) to the
tail of each candidate result at the prior position of p
(position i −l), and select for position i a N-best list
of candidate results from all these candidates....
- 8
- 445
- 0
Báo cáo khoa học: "A Stacked Sub-Word Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging" potx
Ngày tải lên :
17/03/2014, 00:20
... model, joint word segmen-
tation and POS tagging is decomposed into two
steps: (1) coarse-grained word segmentation and
tagging, and (2) fine-grained sub -word tagging. The
workflow is shown in ... inter-
mediate sub -word structure for joint segmentation
and tagging. Since the sub-words are large enough
in practice, the decoding for POS tagging over sub-
words is efficient. Finally, the Chinese language ... effective and effi-
cient solution for joint Chinese word segmentation
and POS tagging. Our work is motivated by several
characteristics of this problem. First of all, a major-
ity of words are...
- 10
- 412
- 0
Báo cáo khoa học: "Automatic Adaptation of Annotation Standards: Chinese Word Segmentation and POS Tagging – A Case Study" potx
Ngày tải lên :
17/03/2014, 01:20
... con-
ducted for two tasks: word segmentation alone,
and joint segmentation and POS tagging (Joint
S&T). The performance measurement indicators
for word segmentation and Joint S&T are bal-
anced ... in the context of Chinese word
segmentation and part-of-speech tagging,
where no segmentation and POS tagging
standards are widely accepted due to the
lack of morphology in Chinese. Experi-
ments ... that when word segmenta-
tion and POS tagging are conducted jointly, the
performance for segmentation improves since the
POS tags provide additional information to word
segmentation (Ng and Low,...
- 9
- 404
- 0
Tài liệu Báo cáo khoa học: "Chinese Word Segmentation without Using Lexicon and Hand-crafted Training Data" pdf
Ngày tải lên :
20/02/2014, 18:20
... ~') > mi(;~?: t~),
and mY(~." ~) > mY(/~: f/:), however, "~J~:~""7~:
~'"'~}~:~'"'~: ~"should be separated and "~:
~'"'~:~'"'~: ...
Abstract
Chinese word segmentation is the first step in any
Chinese NLP system. This paper presents a new
algorithm for segmenting Chinese texts without
making use of any lexicon and hand-crafted ... Chinese
word segmentation is therefore the first step for any
Chinese information processing system[ 1].
Almost all methods for Chinese word
segmentation developed so far, both statistical and...
- 7
- 396
- 0
Báo cáo khoa học: "Exploring Deterministic Constraints: From a Constrained English POS Tagger to an Efficient ILP Solution to Chinese Word Segmentation" ppt
Ngày tải lên :
07/03/2014, 18:20
... decoding.
3 Chinese Word Segmentation (CWS)
3.1 Word segmentation as character tagging
Considering the ambiguity problem that a Chinese
character may appear in any relative position in a
word and the ... beginning of a word and I
all other positions; and 2) BMES: where B, M and E
represent the beginning, middle and end of a multi-
character word respectively, and S tags a single-
character word. For ... Character- and word- based features of a possi-
ble word w
i
over the input character sequence c. Suppose
that w
i
= c
i
0
c
i
1
c
i
2
, and its preceding and following char-
acters are c
l
and c
r
respectively.
parameter...
- 9
- 425
- 0
Báo cáo khoa học: "Joint and conditional estimation of tagging and parsing models∗" docx
Ngày tải lên :
08/03/2014, 05:20
... statis-
tically).
4 Shift-reduce parsing
The previous section compared similiar joint and
conditional tagging models. This section com-
pares a pair of joint and conditional parsing mod-
els. The models ... t
j
is the tag for word w
j
(to simplify the formu-
lae, w
0
, t
0
, w
m+1
and t
m+1
are always taken to
be end-markers). Standard HMM tagging models
define a joint distribution over word- tag sequence
pairs; ... Lari and S.J. Young. 1990. The estimation
of Stochastic Context-Free Grammars using the
Inside-Outside algorithm. Computer Speech and
Language, 4(35-56).
Andrew McCallum, Dayne Freitag, and Fernando
Pereira....
- 8
- 370
- 0
Báo cáo khoa học: "Parsing the Internal Structure of Words: A New Paradigm for Chinese Word Segmentation" doc
Ngày tải lên :
17/03/2014, 00:20
... model
for word structure parsing is integrated with con-
stituent parsing. There has been many efforts to in-
tegrate Chinese word segmentation, part-of-speech
tagging and parsing (Wu and Zixin, ... Wang, Kentaro Torisawa, and Hitoshi
Isahara. 2009. An error-driven word- character hybrid
model for joint Chinese word segmentation and POS
tagging. In Proceedings of the Joint Conference of the
47th ... Linguis-
tics.
Wenbin Jiang, Liang Huang, and Qun Liu. 2009. Au-
tomatic adaptation of annotation standards: Chinese
word segmentation and POS tagging – a case study. In
Proceedings of the Joint Conference of the...
- 10
- 476
- 0
Tài liệu Báo cáo khoa học: "Rethinking Chinese Word Segmentation: Tokenization, Character Classification, or Wordbreak Identification" pdf
Ngày tải lên :
20/02/2014, 12:20
... Processing, pp. 147-173.
Gao, J. and A. Wu and Mu Li and C N.Huang and H. Li
and X. Xia and H. Qin. 2004. Adaptive Chinese Word
Segmentation. In Proceedings of ACL-2004.
Meng, H. and C. W. Ip. 1999. An ... N. 2003. Chinese Word Segmentation as Charac-
ter Tagging. Computational Linguistics and Chinese
Language Processing. 8(1): 29-48
Redington, M. and N. Chater and C. Huang and L. Chang
and K. Chen. ... that
Chinese word segmentation is the classifi-
cation of a string of character-boundaries
(CB’s) into either word- boundaries (WB’s)
and non -word- boundaries. In Chinese, CB’s
are delimited and...
- 4
- 301
- 0
Tài liệu Báo cáo khoa học: "Joint Word Segmentation and POS Tagging using a Single Perceptron" docx
Ngày tải lên :
20/02/2014, 09:20
... UK
{yue.zhang,stephen.clark}@comlab.ox.ac.uk
Abstract
For Chinese POS tagging, word segmentation
is a preliminary step. To avoid error propa-
gation and improve segmentation by utilizing
POS information, segmentation and tagging
can be ... outputs.
In this paper, we propose a novel joint model
for Chinese word segmentation and POS tagging,
which does not limiting the interaction between
segmentation and POS information in reducing ... word segmentation and POS tagging
are still performed separately, and exact inference
for both is possible. However, the interaction be-
tween POS and segmentation is restricted by rerank-
ing: POS...
- 9
- 576
- 0
Báo cáo khoa học: "Joint Hebrew Segmentation and Parsing using a PCFG-LA Lattice Parser" docx
Ngày tải lên :
17/03/2014, 00:20
... lattice parsing are possible.
These include joint segmentation and parsing of
Chinese, empty element prediction (see (Cai et al.,
2011) for a successful application), and a princi-
pled handling ... remarkable, and constitute state-
of-the-art tagging for Hebrew.
The strengths of the system can be attributed to
three factors: (1) performing segmentation, tagging
and parsing jointly using lattice parsing, ... F-measure of about 88.8% for the
gold segmentation and tagging, and about 82.8% for
gold segmentation only. This shows the adequacy
of the PCFG-LA methodology for parsing the He-
brew treebank, but...
- 6
- 376
- 0