Multi-Instrument MIDI Transcription (YourMT3+) · TelkNet

MIDI / transcriptionGPU workload

Multi-Instrument MIDI Transcription (YourMT3+)

Users who need editable MIDI from a full mix quickly

Multi-instrument MIDI drafts for scoring, arranging, harmony analysis, and DAW cleanup

3 credits/useAudio file inputMax 50 MBEstimated 180-900 seconds

Input

Full songs, ensembles, or multi-instrument demos through the YourMT3+ AMT path

Audio formats

mp3wavflacoggm4aaac

Output

Multi-instrument MIDI drafts for scoring, arranging, harmony analysis, and DAW cleanup

Best for

Users who need editable MIDI from a full mix quickly

Models, parameters, and sources

Multi-Instrument MIDI Transcription (YourMT3+) follows the official YourMT3+ checkpoint family for full-mix multi-instrument transcription.

YourMT3+

YourMT3+ checkpoints for multi-instrument automatic music transcription on full mixes or demos.

mimbres/YourMT3 TelkNet music-to-midi adapter YourMT3 arXiv MT3 arXiv 2025 AMT Challenge paper Official leaderboard

Architecture: YourMT3+ adds hierarchical time-frequency attention, MoE variants, and multi-channel decoding on top of MT3-style token decoding.
Recommended TelkNet value: YPTF.MoE+Multi (PS) for quality-first multi-instrument drafts.
Output: editable multi-track MIDI with quantization, velocity defaults, and post-processing controls.

Model comparison

Model

Role

Why it is used

Output impact

ModelMIROS

amt-os/ai4m-miros 2025 AMT Challenge paper Official leaderboard

RoleChallenge-ranked multi-instrument AMT

Why it is usedUse when the MIROS runtime is available and maximum multi-instrument recognition quality is preferred.

Output impactMulti-track MIDI

ModelYourMT3+ YPTF.MoE+Multi

mimbres/YourMT3 YourMT3 arXiv 2025 AMT Challenge paper Official leaderboard

RoleDefault robust multi-instrument AMT

Why it is usedStable TelkNet path with exposed checkpoint, quantization, and post-processing controls.

Output impactMulti-track MIDI draft

ModelMT3 baseline

MT3 arXiv 2025 AMT Challenge paper Official leaderboard

RoleHistorical baseline

Why it is usedKept as public benchmark context for the MT3 family, not as the recommended TelkNet path.

Output impactBaseline comparison only

Public benchmark chart

Scores are public benchmark or source-reference rows. They are not a fresh TelkNet run on the uploaded file.

2025 AMT Challenge ranking

Official leaderboard

Multi-instrument transcription challenge rows. Higher F1 is better; shown as public challenge evidence, not a TelkNet re-run.

MIROS#1

F1 (%) 59.98Precision (%) 65.58Recall (%) 57.24Overlap (%) 73.91Runtime (source unit) 22.05

MIROS is the top public row in the cited 2025 AMT Challenge table.

YourMT3-YPTF-MoE-M#2

F1 (%) 59.38Precision (%) 60.10Recall (%) 58.88Overlap (%) 73.05Runtime (source unit) 12.60

MT3 baseline#5

F1 (%) 39.32

MT3 is included as the historical baseline named in the challenge paper.

Basic Pitch#14

F1 (%) 6.34

YourMT3+ Slakh paper rows

YourMT3+ paper

YourMT3+ paper comparison against MT3-family baselines on Slakh-style metrics.

YPTF.MoE+Multi (PS)YourMT3+

Onset F1 (%) 84.60Offset F1 (%) 70.70Drum F1 (%) 90.10

PerceiverTFpaper baseline

Onset F1 (%) 81.90Drum F1 (%) 78.30

MT3paper baseline

Onset F1 (%) 76.00Offset F1 (%) 57.00

Paper and benchmark notes

YourMT3+: Multi-instrument Music Transcription

IEEE MLSP - 2024

YourMT3+ extends MT3 with enhanced transformer architecture, MoE variants, multi-channel decoding, and cross-dataset stem augmentation.

arXiv:2407.04822

MT3: Multi-Task Multitrack Music Transcription

ICLR - 2022

MT3 established multi-task multitrack music transcription with sequence modeling and remains the named baseline for newer AMT comparisons.

arXiv:2111.03017

Advancing Multi-Instrument Music Transcription: Results from the 2025 AMT Challenge

arXiv / OpenReview - 2026

The 2025 AMT Challenge paper reports current multi-instrument challenge rankings including MIROS, YourMT3, MT3, and Basic Pitch rows.

arXiv:2603.27528

Official / repositories

mimbres/YourMT3 TelkNet music-to-midi adapter

Papers / technical notes

YourMT3 arXiv MT3 arXiv 2025 AMT Challenge paper Official leaderboard

Parameter guide

YourMT3 checkpoint: advanced Colab selector; default uses the upstream Space recommendation YPTF.MoE+Multi (noPS).

Use cases

Transcribe full demos and analyze harmony
Turn idea recordings into editable MIDI
Start with multi-track drafts, then refine by instrument in a DAW

Workflow

1Upload a full audio file with a stable tempo
2Wait for multi-instrument detection to produce MIDI
3Import the result into your DAW to fix velocity, quantization, and tracks

Pre-flight checklist

Keep audio with a stable tempo and avoid long silent stretches
More complex arrangements need more manual note correction afterwards
For solo piano, switch to a piano-specialist model instead

Login required to use this tool

Browsing tool info is always free - no account needed.