Command Palette
Search for a command to run...
Ahmed Ali; Najim Dehak; Patrick Cardinal; Sameer Khurana; Sree Harsha Yella; James Glass; Peter Bell; Steve Renals
Abstract
We investigate different approaches for dialect identification in Arabic broadcast speech, using phonetic, lexical features obtained from a speech recognition system, and acoustic features using the i-vector framework. We studied both generative and discriminate classifiers, and we combined these features using a multi-class Support Vector Machine (SVM). We validated our results on an Arabic/English language identification task, with an accuracy of 100%. We used these features in a binary classifier to discriminate between Modern Standard Arabic (MSA) and Dialectal Arabic, with an accuracy of 100%. We further report results using the proposed method to discriminate between the five most widely used dialects of Arabic: namely Egyptian, Gulf, Levantine, North African, and MSA, with an accuracy of 52%. We discuss dialect identification errors in the context of dialect code-switching between Dialectal Arabic and MSA, and compare the error pattern between manually labeled data, and the output from our classifier. We also release the train and test data as standard corpus for dialect identification.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| spoken-language-identification-on-1 | SVM | ACC: 45.2% PRC: 44.8% RCL: 45.4% |
| spoken-language-identification-on-1 | n-gram Language Model | ACC: 40.4% PRC: 40.2% RCL: 41.3% |
| spoken-language-identification-on-1 | Max Ent | ACC: 40% PRC: 40% RCL: 40.6% |
| spoken-language-identification-on-1 | Naive Bayes | ACC: 37.9% PRC: 37.5% RCL: 50.2% |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.