... Minimization of
Mutual Information
An important approach for independent component analysis (ICA) estimation, in-
spired by information theory, is minimization of mutual information.
The motivation of ... can be developed using
mutual information, which is a well-motivated information- theoretic measure of
statistical dependence.
One of the main utilities of mutual information is that it serves ... 10
−4
iteration count
mutual information
Fig. 10.1
The convergence of FastICA for ICs with uniform distributions. The value of
mutual information shown as function of iteration count.
10.5 EXAMPLES
Here...
... controlled.
rapidly changing information about the
networking environment. This generally leads
either to over or under management of resourses.
One of the specific goals of this work is
management of security ... actual
enforcement of these policies. Many of our
design decisions were influenced by the lack of
verifiable enforcement mechanisms for certain
security phenomena. An example of this is
Denial of Service ... provide
required by policies. Often it suffices to reason
about connectivity to analyze availability of
services to groups of users. For instance, instead
of modeling all the details of a file server, we...
... range of issues these
include:
•
a broader assessment of the consequences of economic growth;
•
the contribution of sectors to particular environmental problems; and
•
sectoral implications of ... use;
•
volume of unallocated resources; and
•
mean annual runoff.
Average annual water resources will give an indication of the long term availability of water.
A limitation of this approach ... an
indication of the quality of water used and the quality of water returned to the environment
or for subsequent reuse. An alternative to this would be the collection of data on the mass
load of pollutants...
... amount of those demands and with the course of
the negotiation, I also communicate a copy of such parts of the correspondence of the agents of the two
Governments as relate thereto.
Compilation of ... direct suffrages of the people to
the discharge of the important functions of their chief executive office. Upon the expiration of a single month
Compilation of the Messages and Papers of the Presidents, ... the Senate and House of Representatives of the United States of America in Congress assembled,
That the chairs of the President of the Senate and of the Speaker of the House of Representatives...
... Statistics of the BioScope corpus. The 2nd and 3d
columns show the total number of cues within the datasets; the
4th and 5th columns show the percentage of negated and spec-
ulative sentences.
70% of ... combination of manually compiled rules, a
CRF classifier, and a sequence of post-processing
steps on the same task; Velldal et al (2010) manu-
ally compiled a set of heuristics based on syntactic
information ... neighboring identical siblings of
type *scope* or * are replaced by a single node of
the corresponding type. Figure 3 shows an example
of this transformation.
(a) The children of nodes JJ/NN/NN are
pruned...
... head of constituents. The
example of Fig. 1 shows that the placeholder
0
climbs up to the node governing all the NPs.
5.3 Pruning irrelevant information in large
text trees
Often only a portion of ... ex-
amples of the previous section. From the point of
view of bag -of- word methods, the pairs (T
1
, H
1
)
and (T
1
, H
2
) have both the same intra-pair simi-
larity since the sentences of T
1
and ... co-chairman
of Miramax.”
407
where 0 ≤ λ ≤ 1 and l(f
i
) is the number of lev-
els of the subtree f
i
. Thus λ
l(f
i
)
assigns a lower
weight to larger fragments. When λ = 1, ∆ is
equal to the number of...
... the polarity of words
There are some works that discuss learning the po-
larity of words instead of sentences.
Hatzivassiloglou and McKeown proposed a
method of learning the polarity of adjectives ... are not in the resources.
458
(1) kono software-no riten-ha hayaku ugoku koto
this software-POST advantage-POS T quickly run to
The advantage
of this software is to run quickly.
(2) ketten-ha
jikan-ga ... to automatically
identify the synonyms of the seed and to add them
to the seed adjectives (Wiebe, 2000). Riloff et
al. proposed a bootstrapping approach for learn-
ing subjective nouns (Riloff...
... examples of sen-
tences that our system identified as reasons of
complaints.
(1) Unfortunately, I find that
I am no longer comfortable in
your establishment because of
the unprofessional, ... Orientation
of Adjectives. Proceedings of 35th Annual Meet-
ing of the Assoc. for Computational Linguistics
(ACL-97): 174-181
Hatzivassiloglou, Vasileios and Janyce Wiebe.
2000. Effects of Adjective ... Determin-
ing the Sentiment of Opinions. Proceedings of
COLING-04. pp. 1367-1373. Geneva, Switzer-
land.
Kim, Soo-Min and Eduard Hovy. 2005. Automatic
Detection of Opinion Bearing Words and...
... grammar, rhythm and flow,
appropriateness of tone, and several other specific
characteristics of good text.
In terms ofautomatic evaluation, we are not aware
of any technique that measures only fluency ... Methods
PoStag In the first of these, we constructed a
rough approximation of typical sentence grammar
structure by taking bigrams over part -of- speech
tags.
6
Then, given a string of PoS tags of length
n, t
1
. ... can be fooled
by the method of sentence generation; GLEU, how-
ever, gives a consistent estimate of fluency regard-
less of generation type; and, across all types of gen-
erated sentences examined...
... construction of N-best translation
lexicons from parallel text. Melamed (1995) used
the ratio (LCSR) between the length of the LCS of
two words and the length of the longer word of the
two ... present the evaluations of
ROUGE-L, ROUGE-S, and compare their per-
formance with other automatic evaluation meas-
ures.
5 Evaluations
One of the goals of developing automatic evalua-
tion ... Proceedings of
COLING-92, Nantes, France.
Thompson, H. S. 1991. Automatic Evaluation of
Translation Quality: Outline of Methodology
and Report on Pilot Experiment. In Proceedings
of the Evaluator’s...
... 1
shows the average number of clusters with each
clustering method shown chapter 3 by the part of
speech. WC and WF are the average number of
senses by the part of speech.
In Table 1 and ... the word senses numbered i of
the word x. I
x
is the word sense indexing function
of x that gives an index to each sense of the word
x. All contextual words x
i
±j
of a central word x have ...
contains semantic information. The collocation for
ambiguous words also contains semantic
information about multiple senses for this
ambiguous word. This paper uses the ambiguity of
collocation...
... (20%) out of 210 terms were col-
lected by the system. This low recall primarily
comes from the failure ofautomatic term recogni-
tion (case A in the above classification). Improve-
ment of this ... development)
情報処理学会 (Information Processing
Society of Japan; IPSJ)
√√
意味処理 (semantic processing)
√√
音声処理 (speech processing)
√
音声情報処理 (speech information pro-
cessing)
√√
情報処理 (information processing)
自然言語処理分野 ... Disucssion
First, we examined the precision of the system. We
prepared fifty seed terms in total: ten terms for
each of five genres; natural language processing,
Japanese language, information technology, current
topics,...
... of
their distributions with respect to a presumably
natural class called numericals. Supposing one
of a certain group of characters often occurs as
a neighbor to one of the other groups of ...
how knowing the sort of each character is use-
ful when tokenizing a string of characters into
a string of words and when assigning parts -of-
speech to them, and our method of clustering
characters ... set involving
tens of thousands of characters,
658
We also have c) the necessary decision-trees
for word-splitting and part -of- speech tagging,
each of which contains a set of questions about...