Korean Japanese Voice

• Related Project: private
• Category: Paper Review
• Date: 2023-05-28

JAPANESE AND KOREAN VOICE SEARCH

• url: https://research.google/pubs/japanese-and-korean-voice-search/
• pdf: https://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/37842.pdf?ref=blog.octanove.org
• abstract: This paper describes challenges and solutions for building a successful voice search system as applied to Japanese and Korean at Google. We describe the techniques used to deal with an infinite vocabulary, how modeling completely in the written domain for language model and dictionary can avoid some system complexity, and how we built dictionaries, language and acoustic models in this framework. We show how to deal with the difficulty of scoring results for multiple script languages because of ambiguities. The development of voice search for these languages led to a significant simplification of the original process to build a system for any new language which in in parts became our default process for internationalization of voice search.

[한국어 토크나이저 및 언어모델 색인마킹]

TL;DR

The techniques used to deal with an infinite vocabulary, how modeling completely in the written domain for language model and dictionary can avoid some system complexity, and how dictionaries, language and acoustic models are built in this framework are described.