Audio to sheet music · TelkNet

MIDI / transcriptionGPU workloadSheetSage2-Refined · Source SheetSage2-Refined · Weights SheetSage2 · Weights

Audio to sheet music

Transcribe melodies and chords throughout a song, with more meter and chord types and optional mode detection. Export PDF, MusicXML, MIDI, an ABC score and timed annotations; review the results.

30 credits/useFile inputMax 100 MBEstimated 60-3600 seconds

Input

Supports inputs in formats such as mp3 / wav / flac / ogg / m4a / aac / aif / aiff / mp4 / mov / mkv

Supported formats

mp3wavflacoggm4aaacaifaiffmp4movmkv

Output

PDF · MusicXML · ABC · MIDI

Use case

Transcribe melodies and chords throughout a song, with more meter and chord types and optional mode detection. Export PDF, MusicXML, MIDI, an ABC score and timed annotations; review the results.

Choose a score type

Song melody and chordsExtract melody and chords from a song; coverage depends on the model and recording.Two-hand piano scoreTranscribe piano recordings into a two-hand score. Performance MIDI is also supported.String quartetCreate parts for two violins, viola and cello.

Choose a model family

Audio to sheet music · SheetSage2AvailableExtract melody and chords from a song; coverage depends on the model and recording.Audio to sheet music · HookKernAvailableOn TelkNet, SheetSage transcribes melody-and-chord excerpts of up to 30 seconds into PDF / MusicXML / Humdrum **kern for review. String quartets use a separate model; arbitrary arrangements cannot be fully reconstructed.

Choose a version or processing mode

Melody and chord transcription · SheetSage2-RefinedTranscribe melodies and chords throughout a song, with more meter and chord types and optional mode detection. Export PDF, MusicXML, MIDI, an ABC score and timed annotations; review the results.RecommendedAvailableMelody and chord transcription · SheetSage2Identify vocal and instrumental melodies, chords, beats, meter, key and sections throughout a song. Export PDF, MusicXML, MIDI, an ABC score and timed annotations. Complex mixes require review.Available

Choose a model for your material and purpose, and review the examples before submitting.

Cost, time, formats and parameters depend on the selected model.

Quick feedback

Include the tool name, steps and the problem in your feedback. Screenshots can help us locate it.

Models, parameters, and sources

SheetSage2-RefinedSheetSage2HookKern · Lead sheet

SheetSage2-Refined

SheetSage2-Refined · GitHub SheetSage2-Refined · Hugging Face

Use a key prompt with additional modes; the default uses major and minor only. Some modes may not export to ABC; raw events are retained.

SheetSage2

Identify vocal and instrumental melodies, chords, beats, meter, key and sections throughout a song. Export PDF, MusicXML, MIDI, an ABC score and timed annotations. Complex mixes require review.

SheetSage2

Remove chord accompaniment from the score and playback while preserving raw events and chord annotations. Off by default.

HookKern · Lead sheet

Transcribe a selected audio excerpt of up to 30 seconds into a melody-and-chord lead sheet in PDF / MusicXML / Humdrum **kern for review.

HookKern source (pinned)HookKern weights (pinned)MuQ encoder (pinned)SheetSage-A2S paper

Paper and benchmark notes

Audio-to-Score Transcription using Pre-trained Features, Data Augmentation, and the New SheetSage-A2S Dataset

ACM Multimedia - 2026

On TelkNet, SheetSage transcribes melody-and-chord excerpts of up to 30 seconds into PDF / MusicXML / Humdrum **kern for review. String quartets use a separate model; arbitrary arrangements cannot be fully reconstructed.

Paper

Official / repositories

SheetSage2-Refined · GitHub SheetSage2-Refined · Hugging Face SheetSage2 HookKern source (pinned)HookKern weights (pinned)MuQ encoder (pinned)

Papers / technical notes

SheetSage-A2S paper

Workflow

1Prepare an input file that matches the format requirements
2Check the melody, chords and beats against the recording. Download the PDF to view or print, and use MusicXML or ABC for further editing.

Models in this field

3 entries

Includes public test results for models used here and elsewhere. The complete source table is shown by default; conditions and metrics can also be selected for comparison. Scores from different test conditions are not directly comparable.

Only records with verified public inference implementations and matching weights are shown; algorithms requiring no weights are also eligible. Closed services, unreleased weights and unmatched experiment versions are excluded. This is not an all-model leaderboard.

Public weights do not establish a fully open-source license. Expand the data for declared weight licenses and access conditions. Undeclared licenses are marked separately.

BenchmarkRanking category

The chart shows author-reported scores. The site configuration has not been evaluated under the same conditions, so these are not labelled as site results.

SheetSage2-Refined · beats

Choose a dataset to view all metrics for each model. Rows follow the official rank or selected metric. Bold marks each column’s best comparable value, including ties. Different evaluation protocols are ranked separately; missing scores are shown as -.

Deployable entries 3 / source rows 3

The Refined author evaluated identical audio in held-out sets: 95 pop test and 47 validation songs with private annotations; 50 odd-meter songs include 9 recordings and 41 renders; also 300 in-distribution synthetic pieces and 1026 HookTheory clips. Both barlines must match within ±70 ms with none extra; consistent regrouping permits the documented meter regroupings. Melody requires the same pitch and 50 ms onsets; key changes use ±2 s. Mode evaluation uses its optional mode. These results are separate from the original paper.

Rank by metric

SheetSage2-Refined · beats
Metric rank	Model	Pop songs, test (95 songs, mostly 4/4): beat↑	Pop songs, test: downbeat↑	HookTheory test (1026 clips): beat↑	Odd-meter songs (50): beat↑	Odd-meter songs: downbeat↑	Synthetic meters (300): beat↑	Synthetic meters: downbeat↑
1	SheetSage2-Refined · beat head Public weights · Inference code heads/beat-v7u.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.978	0.976	0.902	0.928	0.883	0.988	0.955
2	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.969	0.965	0.886	0.895	0.835	0.906	0.839
3	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.966	0.966	0.897	0.849	0.733	0.719	0.368

Original records (3)

SheetSage2-Refined · beats ↗Download complete evaluation dataChecked: 2026-10-25

All evaluation sources (7)

Datasets, versions and conditions remain separate, including sources with no eligible ranking rows.

SheetSage2-Refined · beats ↗
Deployable entries 3 / source rows 3
SheetSage2-Refined · meters ↗
Deployable entries 3 / source rows 3
SheetSage2-Refined · synth-meters ↗
Deployable entries 3 / source rows 3
SheetSage2-Refined · chords ↗
Deployable entries 2 / source rows 2
SheetSage2-Refined · hooktheory ↗
Deployable entries 3 / source rows 3
SheetSage2 · 2610.05336 · benchmark_results.json ↗
Deployable entries 1 / source rows 9
Not ranked: 8
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
SheetSage1 · madmom · Beat This! · S-KEY · ChordFormer · † ChordFormer · SongFormer
HookKern · Table 2 · Quartets ↗
Deployable entries 1 / source rows 4
Not ranked: 3
A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.
Baseline ( Alfaro-Contreras et al., 2024 ) · +1024-Pre-Norm · +MuQ encoder

All original results and sources

Scores apply to the listed dataset, metric and model version; results from different tests are not directly comparable.

SheetSage2-Refined · beats

Deployable entries 3 / source rows 3

Rank by metric

SheetSage2-Refined · beats
Metric rank	Model	Pop songs, test (95 songs, mostly 4/4): beat↑	Pop songs, test: downbeat↑	HookTheory test (1026 clips): beat↑	Odd-meter songs (50): beat↑	Odd-meter songs: downbeat↑	Synthetic meters (300): beat↑	Synthetic meters: downbeat↑
1	SheetSage2-Refined · beat head Public weights · Inference code heads/beat-v7u.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.978	0.976	0.902	0.928	0.883	0.988	0.955
2	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.969	0.965	0.886	0.895	0.835	0.906	0.839
3	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.966	0.966	0.897	0.849	0.733	0.719	0.368

Original records (3)

SheetSage2-Refined · beats ↗Download complete evaluation dataChecked: 2026-10-25

SheetSage2-Refined · meters

Deployable entries 3 / source rows 3

Rank by metric

SheetSage2-Refined · meters
Metric rank	Model	4/4 · 3544 bars		3/4 · 680 bars		6/4 · 589 bars		5/4 · 434 bars		6/8 · 432 bars		12/8 · 233 bars		5/8 · 122 bars		11/8 · 87 bars		2/4 · 63 bars		7/8 · 59 bars		7/4 · 46 bars		all · 6329 bars
Metric rank	Model	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑
1	SheetSage2-Refined · beat head Public weights · Inference code heads/beat-v7u.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.824	0.868	0.768	0.768	0.572	0.795	0.574	0.583	0.794	0.806	0.794	0.794	0.508	0.508	0.563	0.563	0.079	0.159	0.847	0.847	0.565	0.652	0.752	0.801
2	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.713	0.750	0.768	0.768	0.486	0.781	0.512	0.512	0.725	0.745	0.970	0.970	0.008	0.287	0.586	0.586	0.111	0.270	0.305	0.305	0.196	0.196	0.661	0.718
3	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.699	0.749	0.676	0.676	0.275	0.497	0.002	0.002	0.299	0.736	0.597	0.914	0.000	0.000	0.000	0.000	0.063	0.063	0.000	0.000	0.000	0.000	0.534	0.624

Original records (3)

SheetSage2-Refined · meters ↗Download complete evaluation dataChecked: 2026-10-25

SheetSage2-Refined · synth-meters

Deployable entries 3 / source rows 3

Rank by metric

SheetSage2-Refined · synth-meters
Metric rank	Model	4/4 · 3255 bars		6/8 · 2964 bars		3/4 · 2431 bars		3/8 · 1843 bars		5/8 · 1574 bars		5/4 · 1372 bars		11/8 · 1287 bars		12/8 · 1207 bars		7/8 · 1114 bars		6/4 · 1031 bars		7/4 · 991 bars		9/8 · 945 bars		8/8 · 460 bars		2/4 · 340 bars		all · 20814 bars
Metric rank	Model	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑	exact↑	consistent↑
1	SheetSage2-Refined · beat head Public weights · Inference code heads/beat-v7u.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.964	0.964	0.939	0.956	0.946	0.951	0.840	0.853	0.922	0.922	0.960	0.960	0.912	0.919	0.792	0.894	0.954	0.956	0.877	0.890	0.943	0.943	0.905	0.911	0.924	0.924	0.659	0.659	0.916	0.928
2	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.784	0.839	0.842	0.864	0.787	0.810	0.651	0.712	0.730	0.758	0.667	0.672	0.716	0.737	0.558	0.814	0.783	0.794	0.568	0.719	0.673	0.745	0.800	0.808	0.815	0.828	0.347	0.465	0.730	0.782
3	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.436	0.501	0.538	0.561	0.443	0.444	0.147	0.186	0.090	0.090	0.000	0.028	0.008	0.016	0.223	0.483	0.004	0.005	0.139	0.306	0.000	0.105	0.003	0.003	0.474	0.543	0.044	0.115	0.248	0.299

Original records (3)

SheetSage2-Refined · synth-meters ↗Download complete evaluation dataChecked: 2026-10-25

SheetSage2-Refined · chords

Deployable entries 2 / source rows 2

Rank by metric

SheetSage2-Refined · chords
Metric rank	Model	root, test↑	root, valid↑	majmin, test↑	majmin, valid↑	sevenths, test↑	sevenths, valid↑	tetrads, test↑	tetrads, valid↑	slash chords (bass, exact), test↑	slash chords (bass, exact), valid↑	key, test↑	key, valid↑	key changes (F, ±2 s), test↑	key changes (F, ±2 s), valid↑	tension chords (9th, 11th, 13th, add), test: recall / precision
1	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.864	0.880	0.886	0.885	0.829	0.825	0.770	0.780	0.520	0.515	0.920	0.909	0.629	0.721	0.232 / 0.485
2	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.821	0.822	0.871	0.845	0.762	0.777	0.678	0.704	0.366	0.386	0.840	0.814	0.568	0.667	0.000 / —

Original records (2)

SheetSage2-Refined · chords ↗Download complete evaluation dataChecked: 2026-10-25

SheetSage2-Refined · hooktheory

Deployable entries 3 / source rows 3

Rank by metric

SheetSage2-Refined · hooktheory
Metric rank	Model	melody (note F)↑	key with mode↑	key with mode, the 98 modal clips↑
1	SheetSage2-Refined · melody head Public weights · Inference code heads/melody-m4.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.713	-	-
2	SheetSage2-Refined Public weights · Inference code decoder.safetensors + bar_features.safetensors + sheetsage2/model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.682	0.719	0.315
3	SheetSage2 Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	0.664	0.722	0.005

Original records (3)

SheetSage2-Refined · hooktheory ↗Download complete evaluation dataChecked: 2026-10-25

SheetSage2 · 2610.05336 · benchmark_results.json

Deployable entries 1 / source rows 9

Not ranked: 8

A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.

SheetSage1 · madmom · Beat This! · S-KEY · ChordFormer · † ChordFormer · SongFormer · SheetSage1

The authors used the paper preset and BF16; the site candidate uses the default preset and FP32. These are not site measurements. Beat/downbeat tolerance is 70 ms, excluding the first 5 s for all models; melody matches pitch class and 50 ms onsets, without offsets. Beat This! averages three seeds; ChordFormer uses ensembles or held-out folds by dataset. Ranks apply only within matching conditions; sources contain full settings.

Rank by metric

SheetSage2 · 2610.05336 · benchmark_results.json
Metric rank	Model	Beat · GTZAN · F1	Beat · osu2017 · F1	Downbeat · GTZAN · F1	Downbeat · osu2017 · F1	Key · GiantSteps · Score	Key · GTZAN · Score	Chord · osu2017 · Maj/min	Chord · Chords1217 · Maj/min	Chord · JAAH · Maj/min	Structure · HarmonixSet			Melody · RWC-Pop		Melody · Rock Corpus · Vocal F1
Metric rank	Model	Beat · GTZAN · F1	Beat · osu2017 · F1	Downbeat · GTZAN · F1	Downbeat · osu2017 · F1	Key · GiantSteps · Score	Key · GTZAN · Score	Chord · osu2017 · Maj/min	Chord · Chords1217 · Maj/min	Chord · JAAH · Maj/min	Accuracy↑	F1 @ 0.5 s↑	F1 @ 3 s↑	Vocal F1↑	Full F1↑	Melody · Rock Corpus · Vocal F1
-	SheetSage2-AR Public weights · Inference code model.safetensors Inference code Evaluation settings Weight license (repository declaration): CC-BY-NC-4.0	86.27	93.01	80.45	92.90	77.73	75.77	90.08	83.81	64.50	80.51	67.96	82.86	82.51	75.29	67.08

Original records (1)

SheetSage2 · 2610.05336 · benchmark_results.json ↗Download complete evaluation dataChecked: 2026-10-25

HookKern · Table 2 · Quartets

Deployable entries 1 / source rows 4

Not ranked: 3

A complete public inference package for these experiments has not been verified. Other weights with the same model name do not qualify.

Baseline ( Alfaro-Contreras et al., 2024 ) · +1024-Pre-Norm · +MuQ encoder

HookKern compares SER separately for popular lead sheets and string quartets; lower is better. Only experiments matched to released weights are shown, without ranking across datasets.

Rank by metric

HookKern · Table 2 · Quartets
Metric rank	Model	SheetSage-A2S			Quartets · SER
Metric rank	Model	SER↓	Melody SER↓	Chord SER↓	Quartets · SER
-	+Augmented data Public weights · Inference code quartets_a2s.ckpt sheetsage_a2s.ckpt Inference codeWeight license not declared	20.92	38.62	22.28	4.98

Original records (1)

HookKern · Table 2 · Quartets ↗Checked: 2026-10-25