본문 바로가기

Deep Learning-Based Context-Sensitive Spelling Typing Error Correction

문서 유형
연구출판물 · 학술지 논문
등재
SCIEScopus
저널 순위
JCR Q1Scopus Q1
저널
IEEE ACCESS8 · pp.152565 · 2020
피인용
Web of Science 23Scopus 34
FWCI (Scopus)
0
JCR IF
JCR 2019 3.745
ISSN
2169-3536

저자

  1. 이정훈제1저자Department of Electrical and Computer Engineering, Pusan National University, Busan, South Korea
  2. 김민호Department of Software, Catholic University of Pusan, Busan, South Korea
  3. 권혁철교신저자Department of Information Computer Science, Pusan National University, Busan, South Korea

초록

This study aims to solve the context-sensitive spelling error problem for English documents. There are two types of spelling errors in English: non-word spelling errors and context-sensitive spelling errors. Non-word spelling errors are simple to correct because they can only be detected by matching the words in sentences with those in a dictionary; however, context-sensitive spelling errors entail increased difficulty of correction because the relationship between the word to be corrected and the surrounding context must be known. Spelling errors are considered noise in every field that uses text information, and preprocessing via document correction is necessary to minimize this problem. Context-sensitive spelling errors include homophone errors (which arise from the incorrect use of words that sound the same but are spelled differently), typographical errors (caused by striking an incorrect key on a keyboard), grammatical errors (which occur when the user does not know the correct grammatical rules), and cross word boundary errors (which arise from incorrect spacing between words). This study focuses on typographical errors. The context-sensitive spelling error problem is solved using the deep learning method, which is not an existing statistical method. The deep learning language model-based correction approach is divided into four parts, namely, correction based on word embedding information, contextual embedding information, an auto-regressive (AR) language model, and an auto-encoding (AE) language model. In this study, the best correction performance was obtained for the AE language model-based approach, and we verified its performance through a detailed correction test.

키워드

Context-sensitive spelling error correctionnatural language processingword embeddingcontextual embeddingauto-regressiveauto-encodingpermutation language model

식별자

Scopus EID
2-s2.0-85090601523
WoS UID
000564284700001