Sub-syllable Representation-based Hmong Language Text-to-Speech Method

Shan CAI , Lin WANG , Mian TAN , Sheng GUO , Lei WU , Fei WANG

Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (19) : 8176 -8185.

PDF
Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (19) : 8176-8185 DOI: 10.12404/j.issn.1671-1815.2305948
research-article
Sub-syllable Representation-based Hmong Language Text-to-Speech Method
Author information +
History +
PDF

Abstract

Speech synthesis of minority languages contributes to the preservation, protection and development of national culture, while the research results in this field are currently limited. To address the problem of speech synthesis errors where words with different tones sound similar, a sub-syllable representation-based text-to-speech method for the Hmong language was proposed. The method utilized sub-syllables as training primitives to accurately represent the pronunciation information of the Hmong language, enabling distinctive learning of similar sounds across different syllables. According to the monotonicity of alignment between text sequence and Mel-spectrogram, a monotonic alignment loss was introduced to guide the attention module to learn alignment more accurately, thereby reducing synthesis phenomena such as word skipping and repetition inherent in the autoregressive attention mechanism. To verify the effectiveness of the proposed method, a self-built Hmong language speech synthesis corpus, HmongSpeech (download link: http://sxjxsf.gzmu.edu.cn/info/1728/1214.htm), was utilized as the benchmark dataset. Comparative experiments were conducted with typical speech synthesis methods. The experimental results show that the proposed method successfully reduces the synthetic error rate caused by the similar pronunciation of words with different tones. Notably, the word error rate is only 0.96%, outperforming the baseline method by 6.25%.

Cite this article

Download citation ▾
Shan CAI, Lin WANG, Mian TAN, Sheng GUO, Lei WU, Fei WANG. Sub-syllable Representation-based Hmong Language Text-to-Speech Method. Science Technology and Engineering, 2024, 24(19): 8176-8185 DOI:10.12404/j.issn.1671-1815.2305948

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (2301KB)

16

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉