algoritma stemming+indonesia antonim ekspatriasi Bahasa Indonesia fungsi stopword list kata dasar dalam bahasa indonesia stemming stemming bahasa indonesia php stop word bahasa indonesia daftar Technique Effective Techniques For Indonesia Text Retrieval

Effective Techniques For Indonesia Text Retrieval

Effective Techniques for Indonesian Text Retrieval
A thesis submitted for the degree of
Doctor of Philosophy
Jelita Asian B.Comp. Sc.(Hons.),
School of Computer Science and Information Technology,
Science, Engineering, and Technology Portfolio,
RMIT University,
Melbourne, Victoria, Australia.
30th March, 2007Declaration
I certify that except where due acknowledgment has been made, the work is that of the
author alone; the work has not been submitted previously, in whole or in part, to qualify
for any other academic award; the content of the thesis is the result of work which has been
carried out since the official commencement date of the approved research program; and, any
editorial work, paid or unpaid, carried out by a third party is acknowledged.
Jelita Asian
School of Computer Science and Information Technology
RMIT University
30th March, 2007ii
Acknowledgments
First and foremost, I thank Justin Zobel, Saied Tahaghoghi, and Falk Scholer for their
patience and general academic and mo… Effective Techniques For Indonesia Text Retrieval
algoritma stemming+indonesia antonim ekspatriasi Bahasa Indonesia fungsi stopword list kata dasar dalam bahasa indonesia stemming stemming bahasa indonesia php stop word bahasa indonesia daftar Technique Stemming Indonesian - Techniques 2

Stemming Indonesian - Techniques 2

Pre x Disallowed su xes
be- -i
di- -an
ke- -i, -kan
me- -an
se- -i,-kan
te- -an
Table 1: Disallowed pre x and su x combinations.
The only exception is that the root word \tahu" is
permitted with the pre x \ke-" and the su x \-i".
The square brackets indicate that an a x is optional.
The previous de nition forms the basis of the rules
used in the approach. However, there are exceptions
and limitations that are incorporated in the rules:
1. Not all combinations are possible. For example,
after a word is pre xed with \di-", the word is
not allowed to be su xed with \-an". A complete list is shown in Table 1
2. The same a x cannot be repeatedly applied. For
example, after a word is pre xed with \te-" or
one of its variations, it is not possible to repeat
the pre x \te-" or any of those variations
3. If a word has one or two characters, then stemming is not attempted.
4. Adding a pre x may change the root word or
a previously-applied pre x; we discuss thi… Stemming Indonesian - Techniques 2
algoritma stemming+indonesia antonim ekspatriasi Bahasa Indonesia fungsi stopword list kata dasar dalam bahasa indonesia stemming stemming bahasa indonesia php stop word bahasa indonesia daftar Technique Stemming Indonesian - Stemming Techniques 1

Stemming Indonesian - Stemming Techniques 1

2 Stemming Techniques
In this section, we describe the ve schemes we have
evaluated for Indonesian stemming. In particular, we
detail the approach of Nazief and Adriani, which performs the best in our evaluation of all approaches in
Section 4. We propose extensions to this approach in
Section 5.

2.1 Nazief and Adriani's Algorithm
The stemming scheme of Nazief and Adriani is described in an unpublished technical report from the
University of Indonesia (1996). In this section, we describe the steps of the algorithm, and illustrate each
with examples; however, for compactness, we omit
the detail of selected rule tables. We refer to this
approach as nazief.
The algorithm is based on comprehensive morphological rules that group together and encapsulate allowed and disallowed a xes, including pre xes, suf-
xes, in xes (insertions) and con xes (combination
of pre xes and su xes). The algorithm also supports
recoding, an approach to restore an initial letter that
was removed from a root… Stemming Indonesian - Stemming Techniques 1