论文标题

利用频谱扩展用于代码开关的口语标识

Exploiting Spectral Augmentation for Code-Switched Spoken Language Identification

论文作者

Rangan, Pradeep, Teki, Sundeep, Misra, Hemant

论文摘要

需要口语标识(盖)系统来识别给定音频样本中存在的语言,通常可能是许多语音处理相关任务(例如自动语音识别(ASR))的第一步。自动识别语音信号中存在的语言不仅在科学上有趣,而且在印度等多语言国家中也具有实际重要性。在许多印度城市,当人们相互互动时,多达三种语言可能会混杂在一起。这些可能包括该省,印地语和英语的官方语言(有时在这些互动期间,邻近省的语言也可能混杂在一起)。这使得在印度背景下的口头盖子任务极具挑战性。尽管已经实施了在印度语言的背景下进行的许多盖子系统,但大多数此类系统都使用了组织内部收集的小规模语音数据。在当前的工作中,我们对三种印度语言(古吉拉特语,泰卢固语和泰米尔语)进行了口语,用英语代码。这项任务是由微软研究团队组织的,是一个口头盖子挑战。在我们的工作中,我们修改了通常的光谱增强方法,并提出了一种语言掩码,以区分语言ID对,从而导致噪音强大的口语盖系统。提出的方法比微软在挑战中建议的两个共享任务中提出的基线系统的盖子精度相对改善了约3-5%。

Spoken language Identification (LID) systems are needed to identify the language(s) present in a given audio sample, and typically could be the first step in many speech processing related tasks such as automatic speech recognition (ASR). Automatic identification of the languages present in a speech signal is not only scientifically interesting, but also of practical importance in a multilingual country such as India. In many of the Indian cities, when people interact with each other, as many as three languages may get mixed. These may include the official language of that province, Hindi and English (at times the languages of the neighboring provinces may also get mixed during these interactions). This makes the spoken LID task extremely challenging in Indian context. While quite a few LID systems in the context of Indian languages have been implemented, most such systems have used small scale speech data collected internally within an organization. In the current work, we perform spoken LID on three Indian languages (Gujarati, Telugu, and Tamil) code-mixed with English. This task was organized by the Microsoft research team as a spoken LID challenge. In our work, we modify the usual spectral augmentation approach and propose a language mask that discriminates the language ID pairs, which leads to a noise robust spoken LID system. The proposed method gives a relative improvement of approximately 3-5% in the LID accuracy over a baseline system proposed by Microsoft on the three language pairs for two shared tasks suggested in the challenge.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源