What tasks can Piano TransKun V2 Aug help with?

MIDI / transcription; Piano MIDI from the separate V2 Aug checkpoint, useful for comparing against the default V2 route; Side-by-side comparison with default V2 to judge whether the augmented checkpoint fits the recording better; Solo piano or single-keyboard material; TransKun V2 Aug is the public data-augmented checkpoint with stronger MIREX summary metrics; Compare V2 and V2 Aug MIDI drafts on the same piano take; Try the MIREX summary-leading TransKun variant for broader generalization

MIDI / transcriptionGPU workload

Piano TransKun V2 Aug

Q: Who is Piano TransKun V2 Aug for?

MIDI / transcription Piano MIDI from the separate V2 Aug checkpoint, useful for comparing against the default V2 route

Q: Which model and keyword entities are connected with Piano TransKun V2 Aug?

TransKun V2 Aug, Yujia-Yan/TransKun, TransKun V2 Aug checkpoint, transkun PyPI, TransKun ISMIR 2024, MIREX 2024 permanent results, TransKun V2, Aria-AMT

Side-by-side comparison with default V2 to judge whether the augmented checkpoint fits the recording better

Piano MIDI from the separate V2 Aug checkpoint, useful for comparing against the default V2 route

2 credits/useAudio file inputMax 50 MBEstimated 20-60 seconds

Input

Solo piano or single-keyboard material; TransKun V2 Aug is the public data-augmented checkpoint with stronger MIREX summary metrics

Audio formats

mp3wavflacoggm4aaac

Output

Piano MIDI from the separate V2 Aug checkpoint, useful for comparing against the default V2 route

Use case

Side-by-side comparison with default V2 to judge whether the augmented checkpoint fits the recording better

Models, parameters, and sources

TransKun V2 Aug is a separate local piano transcription route using the official data-augmentation checkpoint. Submit a piano file to generate MIDI without replacing the default V2 tool.

TransKun V2 AugYujia-Yan/TransKunTransKun V2 Aug checkpointtranskun PyPITransKun ISMIR 2024MIREX 2024 permanent resultsTransKun V2Aria-AMTEleutherAI/aria-amtAria-MIDI HF datasetMIREX 2024 summaryhFT-Transformer

TransKun V2 Aug

TransKun V2 Aug is the separate local data-augmentation checkpoint route using checkpointTransformerAug.zip.

Yujia-Yan/TransKun TransKun V2 Aug checkpoint transkun PyPI TransKun ISMIR 2024 MIREX 2024 permanent results

Architecture: TransKun V2 Aug uses the same non-hierarchical Transformer and neural semi-CRF interval decoding family as TransKun V2.
Runtime: uses checkpointMSimplerAug/checkpoint.pt plus model.conf extracted from checkpointTransformerAug.zip, not the packaged V2 2.0.pt resource.
Output: single-track piano MIDI. MIREX 2024 summary favors V2 Aug, while Maestro note+offset+velocity and pedal onset rows are slightly higher for V2.

Model comparison

Model

Role

Why it is used

Output impact

ModelTransKun V2 Aug

Yujia-Yan/TransKun TransKun V2 Aug checkpoint transkun PyPI TransKun ISMIR 2024 MIREX 2024 permanent results

RoleAugmentation-trained TransKun route

Why it is usedBest when you want the MIREX summary-leading TransKun baseline as its own run rather than silently replacing V2.

Output impactSingle-track piano MIDI from the V2 Aug checkpoint.

ModelTransKun V2

Yujia-Yan/TransKun MIREX 2024 permanent results

RoleFast high-accuracy piano AMT

Why it is usedPublic MIREX rows make it the clearest score-backed piano route in this catalog.

Output impactSolo piano MIDI

ModelAria-AMT

EleutherAI/aria-amt Aria-MIDI HF dataset

RoleSeq-to-seq piano AMT route

Why it is usedAria-AMT paper Table 1 provides MAESTRO/MAPS comparisons; it is not a MIREX leaderboard row.

Output impactSolo piano MIDI

Public leaderboard: MIREX 2024 summary piano transcription leaderboard / MIREX 2024 Maestro piano rows / MIREX 2024 MAPS piano rows / MIREX 2024 SMD piano rows

Open-source deployable scope: these tables include only rows with verified downloadable weights or configurations and a local deployment path. SOTA and Best are relative to the verified rows shown, not hosted/API-only or commercial systems and not a universal leaderboard.

MIREX 2024 summary piano transcription leaderboard

MIREX 2024 permanent results

Verified public/reproducible MIREX rows compare average note-onset F1 across three datasets and holistic note F1 across Maestro and SMD.

Rank	Model	Holistic note F1 (%)	Detailed metrics
MIREX 2024 summary	TransKun V2 AugTelkNetMIREX 2024 permanent results	90.81SOTA	Summary onset F1 (%)96.48Best
MIREX 2024 summary	TransKun V2MIREX 2024 permanent results	87.64	Summary onset F1 (%)94.90
MIREX 2024 summary	hFT-TransformerMIREX 2024 permanent results	83.59	Summary onset F1 (%)94.16

MIREX 2024 Maestro piano rows

MIREX 2024 permanent results

Verified public/reproducible Maestro rows with all seven F1 families where published; unavailable pedal results remain blank rather than being inferred.

Rank	Model	Note onset+offset+velocity F1 (%)	Detailed metrics
MIREX 2024 published row	TransKun V2MIREX 2024 permanent results	92.96SOTA	Activation F1 (%)95.30BestNote onset F1 (%)98.32Note onset+offset F1 (%)93.49BestPedal activation F1 (%)95.41BestPedal onset F1 (%)86.42BestPedal onset+offset F1 (%)83.77Best
MIREX 2024 published row	TransKun V2 AugTelkNetMIREX 2024 permanent results	92.64	Activation F1 (%)95.05Note onset F1 (%)98.40BestNote onset+offset F1 (%)93.14Pedal activation F1 (%)94.54Pedal onset F1 (%)84.53Pedal onset+offset F1 (%)81.02
MIREX 2024 published row	hFT-TransformerMIREX 2024 permanent results	89.48	Activation F1 (%)93.07Note onset F1 (%)97.45Note onset+offset F1 (%)90.45

MIREX 2024 MAPS piano rows

MIREX 2024 permanent results

Verified public/reproducible MAPS rows with every published F1 family. MIREX uses ad hoc alignment here, so offset-related values should be read with that annotation caveat.

Rank	Model	Note onset F1 (%)	Detailed metrics
MIREX 2024 published row	TransKun V2 AugTelkNetMIREX 2024 permanent results	92.19SOTA	Activation F1 (%)88.43BestNote onset+offset F1 (%)69.75BestNote onset+offset+velocity F1 (%)54.95BestPedal activation F1 (%)85.83BestPedal onset F1 (%)73.43BestPedal onset+offset F1 (%)55.32Best
MIREX 2024 published row	TransKun V2MIREX 2024 permanent results	88.49	Activation F1 (%)85.35Note onset+offset F1 (%)64.61Note onset+offset+velocity F1 (%)44.46Pedal activation F1 (%)84.49Pedal onset F1 (%)67.32Pedal onset+offset F1 (%)50.88
MIREX 2024 published row	hFT-TransformerMIREX 2024 permanent results	87.89	Activation F1 (%)80.19Note onset+offset F1 (%)57.19Note onset+offset+velocity F1 (%)36.12

MIREX 2024 SMD piano rows

MIREX 2024 permanent results

Verified public/reproducible SMD rows with every published F1 family; unavailable pedal results remain blank.

Rank	Model	Note onset F1 (%)	Detailed metrics
MIREX 2024 published row	TransKun V2 AugTelkNetMIREX 2024 permanent results	98.84SOTA	Activation F1 (%)94.48BestNote onset+offset F1 (%)92.05BestNote onset+offset+velocity F1 (%)88.97BestPedal activation F1 (%)94.47BestPedal onset F1 (%)83.83Pedal onset+offset F1 (%)78.37Best
MIREX 2024 published row	TransKun V2MIREX 2024 permanent results	97.90	Activation F1 (%)93.40Note onset+offset F1 (%)89.90Note onset+offset+velocity F1 (%)82.32Pedal activation F1 (%)94.20Pedal onset F1 (%)83.88BestPedal onset+offset F1 (%)77.30
MIREX 2024 published row	hFT-TransformerMIREX 2024 permanent results	97.13	Activation F1 (%)91.15Note onset+offset F1 (%)86.92Note onset+offset+velocity F1 (%)77.69

Paper and benchmark notes

Scoring Time Intervals Using Non-Hierarchical Transformer for Automatic Piano Transcription

ISMIR - 2024

The TransKun V2 paper reports a transformer interval-scoring architecture and a higher F1 result on Maestro subtasks.

arXiv:2404.09466

Skipping the Frame-Level: Event-Based Piano Transcription with Neural Semi-CRFs

NeurIPS - 2021

The 2021 Semi-CRF paper frames piano transcription as interval/event prediction instead of stitching frame-level detections.

OpenReview

Official / repositories

Yujia-Yan/TransKun TransKun V2 Aug checkpoint transkun PyPI

Papers / technical notes

TransKun ISMIR 2024 MIREX 2024 permanent results

Parameter guide

Solo piano: these models are intended for clean piano or keyboard recordings.

Use cases

Compare V2 and V2 Aug MIDI drafts on the same piano take
Try the MIREX summary-leading TransKun variant for broader generalization
Keep pedal/velocity-sensitive V2 output available as a separate choice

Workflow

1Upload a solo piano or single keyboard source
2Run the official TransKun V2 Aug checkpoint locally
3Compare the output with TransKun V2 if pedal or velocity detail matters

Pre-flight checklist

Best for solo piano; not designed for full-band mixes
V2 Aug leads MIREX summary metrics, while V2 is higher on some Maestro pedal/velocity rows
Runs from local open-source TransKun code and downloaded public checkpoint, not an external API

Models, parameters, and sources

TransKun V2 Aug is a separate local piano transcription route using the official data-augmentation checkpoint. Submit a piano file to generate MIDI without replacing the default V2 tool.

Rank

Model

Holistic note F1 (%)

Detailed metrics

MIREX 2024 summary

TransKun V2 AugTelkNetMIREX 2024 permanent results

90.81SOTA

Summary onset F1 (%)96.48Best

MIREX 2024 summary

TransKun V2MIREX 2024 permanent results

87.64

Summary onset F1 (%)94.90

MIREX 2024 summary

hFT-TransformerMIREX 2024 permanent results

83.59

Summary onset F1 (%)94.16

Rank

Model

Note onset+offset+velocity F1 (%)

Detailed metrics

MIREX 2024 published row

TransKun V2MIREX 2024 permanent results

92.96SOTA

Activation F1 (%)95.30BestNote onset F1 (%)98.32Note onset+offset F1 (%)93.49BestPedal activation F1 (%)95.41BestPedal onset F1 (%)86.42BestPedal onset+offset F1 (%)83.77Best

MIREX 2024 published row

TransKun V2 AugTelkNetMIREX 2024 permanent results

92.64

Activation F1 (%)95.05Note onset F1 (%)98.40BestNote onset+offset F1 (%)93.14Pedal activation F1 (%)94.54Pedal onset F1 (%)84.53Pedal onset+offset F1 (%)81.02

MIREX 2024 published row

hFT-TransformerMIREX 2024 permanent results

89.48

Activation F1 (%)93.07Note onset F1 (%)97.45Note onset+offset F1 (%)90.45

Rank

Model

Note onset F1 (%)

Detailed metrics

MIREX 2024 published row

TransKun V2 AugTelkNetMIREX 2024 permanent results

92.19SOTA

Activation F1 (%)88.43BestNote onset+offset F1 (%)69.75BestNote onset+offset+velocity F1 (%)54.95BestPedal activation F1 (%)85.83BestPedal onset F1 (%)73.43BestPedal onset+offset F1 (%)55.32Best

MIREX 2024 published row

TransKun V2MIREX 2024 permanent results

88.49

Activation F1 (%)85.35Note onset+offset F1 (%)64.61Note onset+offset+velocity F1 (%)44.46Pedal activation F1 (%)84.49Pedal onset F1 (%)67.32Pedal onset+offset F1 (%)50.88

MIREX 2024 published row

hFT-TransformerMIREX 2024 permanent results

87.89

Activation F1 (%)80.19Note onset+offset F1 (%)57.19Note onset+offset+velocity F1 (%)36.12

Rank

Model

Note onset F1 (%)

Detailed metrics

MIREX 2024 published row

TransKun V2 AugTelkNetMIREX 2024 permanent results

98.84SOTA

Activation F1 (%)94.48BestNote onset+offset F1 (%)92.05BestNote onset+offset+velocity F1 (%)88.97BestPedal activation F1 (%)94.47BestPedal onset F1 (%)83.83Pedal onset+offset F1 (%)78.37Best

MIREX 2024 published row

TransKun V2MIREX 2024 permanent results

97.90

Activation F1 (%)93.40Note onset+offset F1 (%)89.90Note onset+offset+velocity F1 (%)82.32Pedal activation F1 (%)94.20Pedal onset F1 (%)83.88BestPedal onset+offset F1 (%)77.30

MIREX 2024 published row

hFT-TransformerMIREX 2024 permanent results

97.13

Activation F1 (%)91.15Note onset+offset F1 (%)86.92Note onset+offset+velocity F1 (%)77.69

Piano TransKun V2 Aug

Models, parameters, and sources

TransKun V2 Aug

Model comparison

Public leaderboard: MIREX 2024 summary piano transcription leaderboard / MIREX 2024 Maestro piano rows / MIREX 2024 MAPS piano rows / MIREX 2024 SMD piano rows

MIREX 2024 summary piano transcription leaderboard

MIREX 2024 Maestro piano rows

MIREX 2024 MAPS piano rows

MIREX 2024 SMD piano rows

Paper and benchmark notes

Scoring Time Intervals Using Non-Hierarchical Transformer for Automatic Piano Transcription

Skipping the Frame-Level: Event-Based Piano Transcription with Neural Semi-CRFs

Official / repositories

Papers / technical notes

Parameter guide

Use cases

Workflow

Pre-flight checklist

Piano TransKun V2 Aug

Models, parameters, and sources

TransKun V2 Aug

Model comparison

Public leaderboard: MIREX 2024 summary piano transcription leaderboard / MIREX 2024 Maestro piano rows / MIREX 2024 MAPS piano rows / MIREX 2024 SMD piano rows

MIREX 2024 summary piano transcription leaderboard

MIREX 2024 Maestro piano rows

MIREX 2024 MAPS piano rows

MIREX 2024 SMD piano rows

Paper and benchmark notes

Scoring Time Intervals Using Non-Hierarchical Transformer for Automatic Piano Transcription

Skipping the Frame-Level: Event-Based Piano Transcription with Neural Semi-CRFs

Official / repositories

Papers / technical notes

Parameter guide

Use cases

Workflow

Pre-flight checklist

Related use-case guides

Login required to use this tool