Enhanced Automatic Drum Transcription via Drum Stem Source Separation
arXiv - 2025
Loading...
ADTOF Plus · ADTOF Direct · ADT_STR · MSG-LD. Full mixes go through the model’s drum-extraction pipeline first. Isolated drums go directly to transcription or drum-stem separation.
Input
Supports inputs in formats such as mp3 / wav / flac / ogg / m4a / aac / aif / aiff / mp4 / mov / mkv
Supported formats
Output
MIDI
Use case
Edit notes, instrumentation and performance details.
Choose a model for your material and purpose, and review the examples before submitting.
Cost, time, formats and parameters depend on the selected model.
Include the tool name, steps and the problem in your feedback. Screenshots can help us locate it.
ADT_STR detects onsets and velocities for 26 drum classes and exports MIDI.
MSG-LD generates five drum stems and detects onsets; MIDI uses fixed velocity 100 and playback duration 0.1 seconds.
MSG-LD generates five drum stems and detects onsets; MIDI uses fixed velocity 100 and playback duration 0.1 seconds.
ADTOF Plus adds drum separation, velocity mapping and open/closed hi-hat processing to ADTOF transcription and accepts full mixes.
ADTOF Direct transcribes isolated drums with PyTorch ADTOF. For full-mix input, TelkNet first extracts drums with AudioSep-Hive; it does not apply Plus velocity or open/closed hi-hat post-processing.
arXiv - 2025
ISMIR - 2021
Signals - 2023
Includes public test results for models used here and elsewhere. The complete source table is shown by default; conditions and metrics can also be selected for comparison. Scores from different test conditions are not directly comparable.
Only records with verified public inference implementations and matching weights are shown; algorithms requiring no weights are also eligible. Closed services, unreleased weights and unmatched experiment versions are excluded. This is not an all-model leaderboard.
Public weights do not establish a fully open-source license. Expand the data for declared weight licenses and access conditions. Undeclared licenses are marked separately.
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
The ADT-STR README recommendation conflicts with its score figure. This ranking uses the values labelled in the official figure.
| Metric rank | Model | ENST↑F1 (%) | MDB↑F1 (%) |
|---|---|---|---|
| 1 | ADT-STR · τ=0.4Public weights · Inference code | 60 | 71 |
| 2 | ADT-STR · τ=0.6Used on this sitePublic weights · Inference code | 58 | 65 |
| 3 | ADT-STR · τ=0.8Public weights · Inference code | 52 | 61 |
Markers identify models or components used here. Scores and settings come from the cited tests, not a new evaluation of the complete site pipeline.
Datasets, versions and conditions remain separate, including sources with no eligible ranking rows.
Deployable entries 2 / source rows 2
Deployable entries 6 / source rows 6
Deployable entries 3 / source rows 6
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
Vogl et al. 8-class baseline · MDB · 8-class evaluation · onset only · 50 ms · Vogl et al. 8-class baseline · RBMA · 8-class evaluation · onset only · 50 ms · Vogl et al. 8-class baseline · ENST · 8-class evaluation · onset only · 50 ms
Deployable entries 0 / source rows 8
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
Setting-1 · ENST · Setting-2 · ENST · Setting-3 · ENST · Setting-4 · ENST · Setting-1 · MDB · Setting-2 · MDB · Setting-3 · MDB · Setting-4 · MDB
Deployable entries 2 / source rows 3
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
LarsNet
Deployable entries 2 / source rows 4
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
MSG-LD Vanilla · MSG-LD TB
Scores apply to the listed dataset, metric and model version; results from different tests are not directly comparable.
The table includes only models with public weights or configurations that can run locally.
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
Deployable entries 2 / source rows 2
ADTOF-PyTorch README · PyTorch 88.51 · Keras 88.74
| Metric rank | Model | Recall↑ | Precision↑ | F-measure↑ |
|---|---|---|---|---|
| 1 | ADTOF (original)Public weights · Inference code | 88.68 | 89.90 | 88.74 |
| 2 | ADTOF-pytorchPublic weights · Inference code | 88.26 | 89.83 | 88.51 |
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
Values come from the linked public source. Row labels identify the test set or checkpoint; unreported scores are shown as -.
| Metric rank | Model | Test setting | F1 (%)↑ | Precision (%)↑ | Recall (%)↑ |
|---|---|---|---|---|---|
| 1 | ADTOF PlusPublic weights · Inference codeMDX23C 5-stemMDX23C full-mix drumsADTOF PyTorchInference code drumsep_5stems_mdx23c_jarredou.ckptWeight license (repository declaration): mit | MDB · 5 classes · onset only · 50 ms | 89 | 89 | 89 |
| 2 | Original ADTOFPublic weights · Inference code | MDB · 5 classes · onset only · 50 ms | 87 | - | - |
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
Values come from the linked public source. Row labels identify the test set or checkpoint; unreported scores are shown as -.
| Metric rank | Model | Test setting | F1 (%)↑ | Precision (%)↑ | Recall (%)↑ |
|---|---|---|---|---|---|
| - | ADTOF PlusPublic weights · Inference codeMDX23C 5-stemMDX23C full-mix drumsADTOF PyTorchInference code drumsep_5stems_mdx23c_jarredou.ckptWeight license (repository declaration): mit | MDB · 8-class evaluation · onset only · 50 ms | 84 | 84 | 84 |
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
Deployable entries 2 / source rows 3
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
LarsNet
The paper reports OB, TB and OBTB separately; OB scores do not describe the default OBTB. Note F1 and audio mel-MSE/FAD are separate tables. The paper's detection pipeline has not been remeasured here.
| Metric rank | Model | MDB · Kick | MDB · Snare | MDB · Toms | MDB · Hi-Hats | MDB · Cymbals | MDB · Overall | ENST · Kick | ENST · Snare | ENST · Toms | ENST · Hi-Hats | ENST · Cymbals | ENST · Overall | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | ||
| 1 | ADTOFPublic weights · Inference code | 0.851 | 0.790 | 0.923 | 0.752 | 0.828 | 0.690 | 0.520 | 0.520 | 0.520 | 0.773 | 0.859 | 0.703 | 0.849 | 0.802 | 0.902 | 0.795 | 0.813 | 0.778 | 0.795 | 0.984 | 0.667 | 0.599 | 0.932 | 0.441 | 0.581 | 0.669 | 0.513 | 0.777 | 0.936 | 0.663 | 0.657 | 0.788 | 0.563 | 0.709 | 0.908 | 0.582 |
| 2 | MSG-LD OBPublic weights · Inference code | 0.931 | 0.939 | 0.923 | 0.760 | 0.791 | 0.732 | 0.268 | 0.309 | 0.236 | 0.650 | 0.550 | 0.794 | 0.481 | 0.663 | 0.377 | 0.707 | 0.709 | 0.704 | 0.821 | 0.941 | 0.729 | 0.642 | 0.698 | 0.594 | 0.491 | 0.415 | 0.602 | 0.630 | 0.643 | 0.618 | 0.391 | 0.611 | 0.287 | 0.640 | 0.695 | 0.593 |
Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.
Deployable entries 2 / source rows 4
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
MSG-LD Vanilla · MSG-LD TB
The paper reports OB, TB and OBTB separately; OB scores do not describe the default OBTB. Note F1 and audio mel-MSE/FAD are separate tables. The paper's detection pipeline has not been remeasured here.
| Metric rank | Model | MDB Overall | ENST Overall | Mean overall F1 (2 sets) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | F1↑ | P↑ | R↑ | ||
| 1 | MSG-LD OBPublic weights · Inference code | 0.707 | 0.709 | 0.704 | 0.640 | 0.695 | 0.593 | 0.674 | 0.674 | 0.674 |
| 2 | MSG-LD OBTBPublic weights · Inference code | 0.690 | 0.709 | 0.672 | 0.636 | 0.703 | 0.580 | 0.663 | 0.663 | 0.663 |