New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems

Chin Ming Hong; Chih Ming Chen; Chao Yang Chiu

New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems

Chin Ming Hong^*, Chih Ming Chen, Chao Yang Chiu

^*Corresponding author for this work

Department of Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

This study proposes a novel statistics-based scheme for new word extraction based on Google news to promote the word identification ability for the lexicon-based Chinese word segmentation systems. To extract news words from the corpuses of news and incrementally add them into the lexicon for the lexicon-based Chinese word segmentation systems provides benefits in terms of automatically constructing a professional lexicon of news and enhancing word identification ability. Compared with another proposed method, the experimental results indicated that the proposed new word extraction scheme not only can more correctly retrieve news words from the categorized corpuses of Google news, but also obtain has larger amount of new words.

Original language	English
Title of host publication	International Joint Conference on Neural Networks 2006, IJCNN '06
Pages	3040-3046
Number of pages	7
Publication status	Published - 2006
Event	International Joint Conference on Neural Networks 2006, IJCNN '06 - Vancouver, BC, Canada Duration: 2006 Jul 16 → 2006 Jul 21

Publication series

Name	IEEE International Conference on Neural Networks - Conference Proceedings
ISSN (Print)	1098-7576

Other

Other	International Joint Conference on Neural Networks 2006, IJCNN '06
Country/Territory	Canada
City	Vancouver, BC
Period	2006/07/16 → 2006/07/21

Keywords

Chinese word segmentation
Information retrieval
Natural language processing
New word extraction

ASJC Scopus subject areas

Software

Cite this

New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems. / Hong, Chin Ming; Chen, Chih Ming; Chiu, Chao Yang.
International Joint Conference on Neural Networks 2006, IJCNN '06. 2006. p. 3040-3046 1716512 (IEEE International Conference on Neural Networks - Conference Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hong, CM, Chen, CM & Chiu, CY 2006, New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems. in International Joint Conference on Neural Networks 2006, IJCNN '06., 1716512, IEEE International Conference on Neural Networks - Conference Proceedings, pp. 3040-3046, International Joint Conference on Neural Networks 2006, IJCNN '06, Vancouver, BC, Canada, 2006/07/16.

@inproceedings{39a63464d4e5449cb309ea989e407c03,

title = "New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems",

abstract = "This study proposes a novel statistics-based scheme for new word extraction based on Google news to promote the word identification ability for the lexicon-based Chinese word segmentation systems. To extract news words from the corpuses of news and incrementally add them into the lexicon for the lexicon-based Chinese word segmentation systems provides benefits in terms of automatically constructing a professional lexicon of news and enhancing word identification ability. Compared with another proposed method, the experimental results indicated that the proposed new word extraction scheme not only can more correctly retrieve news words from the categorized corpuses of Google news, but also obtain has larger amount of new words.",

keywords = "Chinese word segmentation, Information retrieval, Natural language processing, New word extraction",

author = "Hong, {Chin Ming} and Chen, {Chih Ming} and Chiu, {Chao Yang}",

year = "2006",

language = "English",

isbn = "0780394909",

series = "IEEE International Conference on Neural Networks - Conference Proceedings",

pages = "3040--3046",

booktitle = "International Joint Conference on Neural Networks 2006, IJCNN '06",

note = "International Joint Conference on Neural Networks 2006, IJCNN '06 ; Conference date: 16-07-2006 Through 21-07-2006",

}

TY - GEN

T1 - New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems

AU - Hong, Chin Ming

AU - Chen, Chih Ming

AU - Chiu, Chao Yang

PY - 2006

Y1 - 2006

N2 - This study proposes a novel statistics-based scheme for new word extraction based on Google news to promote the word identification ability for the lexicon-based Chinese word segmentation systems. To extract news words from the corpuses of news and incrementally add them into the lexicon for the lexicon-based Chinese word segmentation systems provides benefits in terms of automatically constructing a professional lexicon of news and enhancing word identification ability. Compared with another proposed method, the experimental results indicated that the proposed new word extraction scheme not only can more correctly retrieve news words from the categorized corpuses of Google news, but also obtain has larger amount of new words.

AB - This study proposes a novel statistics-based scheme for new word extraction based on Google news to promote the word identification ability for the lexicon-based Chinese word segmentation systems. To extract news words from the corpuses of news and incrementally add them into the lexicon for the lexicon-based Chinese word segmentation systems provides benefits in terms of automatically constructing a professional lexicon of news and enhancing word identification ability. Compared with another proposed method, the experimental results indicated that the proposed new word extraction scheme not only can more correctly retrieve news words from the categorized corpuses of Google news, but also obtain has larger amount of new words.

KW - Chinese word segmentation

KW - Information retrieval

KW - Natural language processing

KW - New word extraction

UR - http://www.scopus.com/inward/record.url?scp=40649127959&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=40649127959&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:40649127959

SN - 0780394909

SN - 9780780394902

T3 - IEEE International Conference on Neural Networks - Conference Proceedings

SP - 3040

EP - 3046

BT - International Joint Conference on Neural Networks 2006, IJCNN '06

T2 - International Joint Conference on Neural Networks 2006, IJCNN '06

Y2 - 16 July 2006 through 21 July 2006

ER -

New word extraction utilizing google news corpuses for supporting lexicon-based chinese word segmentation systems

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this