An Effective and Robust Framework for Transliteration Exploration

Ea Ee Jan, Niyu Ge, Shih Hsiang Lin, Berlin Chen

研究成果: 書貢獻/報告類型會議論文篇章

摘要

Transliteration is the process of proper name translation based on pronunciation. It is an important process in many multilingual natural language tasks. A common and essential component of transliteration approaches is a verification mechanism that tests if the two names in different languages are translations of each other. Although many transliteration systems have verification as a component, verification as a stand-alone problem is relatively new. In this paper, we propose a simple, effective and robust training framework for the task of verification. We show the many applications of the verification techniques. Our proposed method can operate on both phonemic and orthographic inputs. Our best results show that a simple, straightforward orthographic representation is sufficient and no complex training method is needed. It is effective because it achieves remarkable accuracies. It is robust because it is language-independent. We show that on Chinese and Korean our technique achieves equal error rate well below 1% and around 1% for Japanese using 2009 and 2010 NEWS transliteration generation share task dataset. Our results also show that the orthographic system outperforms the phonemic system. This is especially encouraging because the orthographic inputs are easier to generate and secondly, one does not need to resort to more complex training algorithm to achieve excellent results. This approach is integrated for proper name based cross lingual information retrieval without translation.

原文英語
主出版物標題IJCNLP 2011 - Proceedings of the 5th International Joint Conference on Natural Language Processing
編輯Haifeng Wang, David Yarowsky
發行者Association for Computational Linguistics (ACL)
頁面1332-1340
頁數9
ISBN(電子)9789744665645
出版狀態已發佈 - 2011
事件5th International Joint Conference on Natural Language Processing, IJCNLP 2011 - Chiang Mai, 泰国
持續時間: 2011 11月 82011 11月 13

出版系列

名字IJCNLP 2011 - Proceedings of the 5th International Joint Conference on Natural Language Processing

會議

會議5th International Joint Conference on Natural Language Processing, IJCNLP 2011
國家/地區泰国
城市Chiang Mai
期間2011/11/082011/11/13

ASJC Scopus subject areas

  • 語言與語言學
  • 人工智慧
  • 軟體
  • 語言和語言學

指紋

深入研究「An Effective and Robust Framework for Transliteration Exploration」主題。共同形成了獨特的指紋。

引用此