본문 바로가기

Word sense disambiguation using prior probability estimation based on the korean wordnet

문서 유형
연구출판물 · 학술지 논문
등재
SCIEScopus
저널 순위
JCR Q3Scopus Q2
저널
ELECTRONICS10(23) · 2021
피인용
Web of Science 2Scopus 5
FWCI (Scopus)
0.19
JCR IF
JCR 2020 2.397
ISSN
2079-9292

저자

  1. 김민호제1저자Catholic Univ Pusan, Dept Software, Busan 46252, South Korea
  2. 권혁철교신저자Pusan Natl Univ, Sch Comp Sci & Engn, Busan 46241, South Korea

초록

© 2021 by the authors. Licensee MDPI, Basel, Switzerland.Supervised disambiguation using a large amount of corpus data delivers better performance than other word sense disambiguation methods. However, it is not easy to construct large-scale, sense‐tagged corpora since this requires high cost and time. On the other hand, implementing unsupervised disambiguation is relatively easy, although most of the efforts have not been satisfactory. A primary reason for the performance degradation of unsupervised disambiguation is that the semantic occurrence probability of ambiguous words is not available. Hence, a data deficiency problem occurs while determining the dependency between words. This paper proposes an unsupervised disambiguation method using a prior probability estimation based on the Korean WordNet. This performs better than supervised disambiguation. In the Korean WordNet, all the words have similar semantic characteristics to their related words. Thus, it is assumed that the dependency between words is the same as the dependency between their related words. This resolves the data deficiency problem by determining the dependency between words by calculating the χ2 statistic between related words. Moreover, in order to have the same effect as using the semantic occurrence probability as prior probability, which is used in supervised disambiguation, semantically related words of ambiguous vocabulary are obtained and utilized as prior probability data. An experiment was conducted with Korean, English, and Chinese to evaluate the performance of our proposed lexical disambiguation method. We found that our proposed method had better performance than supervised disambiguation methods even though our method is based on unsupervised disambiguation (using a knowledge‐based approach).

키워드

Data miningInformation extractionKnowledge‐based modelKorean WordNetWord sense disambiguation

식별자

Scopus EID
2-s2.0-85119911409
WoS UID
000742712600001