HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

ODAQ: Open Dataset of Audio Quality - Benchmark on GitHub

{E. A. P. Habets Wolcott W. M. M. Halimeh P. A. Williams S. Dick C.-W. Wu M. Torcoli}

Abstract

ODAQ is a dataset addressing the scarcity of openly available collections of audio signals accompanied by corresponding subjective scores of perceived quality.ODAQ contains 240 audio samples accompanied by corresponding quality scores obtained via MUSHRA listening tests.The quality-rated audio samples are processed versions of the original audio material (also made available). The original audio material consists of: stereo audio with 44.1 or 48 kHz sampling frequency; 14 music excerpts (8 of which are solo recordings); 11 excerpts from movie-like soundtracks with dialogues mixed with music and effects (separate stems and transcripts are also provided).Here, the dataset is used for benchmarking objective measures of audio quality.

Benchmarks

BenchmarkMethodologyMetrics
audio-quality-assessment-on-odaq-open-datasetNMR
Pearson correlation coefficient (PCC): 0.89
audio-quality-assessment-on-odaq-open-datasetPEAQ (ODG)
Pearson correlation coefficient (PCC): 0.87
audio-quality-assessment-on-odaq-open-datasetSMAQ
Pearson correlation coefficient (PCC): 0.77
audio-quality-assessment-on-odaq-open-datasetViSQOLAudioV3
Pearson correlation coefficient (PCC): 0.77
audio-quality-assessment-on-odaq-open-datasetDNSMOS (OVRL)
Pearson correlation coefficient (PCC): 0.38
audio-quality-assessment-on-odaq-open-datasetSI-SDR
Pearson correlation coefficient (PCC): 0.44
audio-quality-assessment-on-odaq-open-datasetPEAQ-CSM
Pearson correlation coefficient (PCC): 0.89
audio-quality-assessment-on-odaq-open-dataset2f-model
Pearson correlation coefficient (PCC): 0.87
audio-quality-assessment-on-odaq-open-datasetPESQ
Pearson correlation coefficient (PCC): 0.74

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp