Command Palette
Search for a command to run...
Open-Unmix - A Reference Implementation for Music Source Separation
{and YukiMitsufuji Fabian-Robert Stöter Stefan Uhlich Antoine Liutkus}

Abstract
Music source separation is the task of decomposing music into its constitutive components,e.g., yielding separated stems for the vocals, bass, and drums. Such a separation has manyapplications ranging from rearranging/repurposing the stems (remixing, repanning, upmixing)to full extraction (karaoke, sample creation, audio restoration). Music separation has a longhistory of scientific activity as it is known to be a very challenging problem. In recent years,deep learning-based systems - for the first time - yielded high-quality separations that alsolead to increased commercial interest. However, until now, no open-source implementationthat achieves state-of-the-art results is available.Open-Unmixcloses this gap by providinga reference implementation based on deep neural networks. It serves two main purposes.Firstly, to accelerate academic research asOpen-Unmixprovides implementations for themost popular deep learning frameworks, giving researchers a flexible way to reproduce results.Secondly, we provide a pre-trained model for end users and even artists to try and use sourceseparation. Furthermore, we designedOpen-Unmixto be one core component in an openecosystem on music separation, where we already provide open datasets, software utilities,and open evaluation to foster reproducible research as the basis of future development.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| music-source-separation-on-musdb18 | UMXL | SDR (avg): 6.316 SDR (bass): 6.015 SDR (drums): 7.148 SDR (other): 4.889 SDR (vocals): 7.213 |
| music-source-separation-on-musdb18 | UMX | SDR (avg): 5.33 SDR (bass): 5.23 SDR (drums): 5.73 SDR (other): 4.02 SDR (vocals): 6.32 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.