4 ms·
Show HN: Public Muscriptor Instance (latest, most powerful Audio-to-MIDI model)
GPU powered models to convert any song to piano
- homarp 1mo agoit uses https://muscriptor.kyutai.org/ https://muscriptor.kyutai.org/ https://kyutai.org/blog/2026-07-10-muscriptor/ https://kyutai.org/blog/2026-07-10-muscriptor/ says We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with Mirelo. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.
- jardy 1mo agoabsolutely - thanks for the reference.
- fweimer 1mo agoI wonder what the intent is behind releasing the weights under a CC-BY-NC license. Is it about restricting any commercial use of the weights, including for inference?
- embedding-shape 1mo agoWoah, that's much more interesting, as it seems to handle more than just the lead instrument/piano, as this Show HN does. Thanks for sharing that, very useful!
- epiccoleman 1mo agoWow, this works way better than I expected. Fed it "Shimmer and Out" by Lotus, the intro of which is just a pretty simple guitar riff based around triad shapes - but it's the kind of thing I've seen Chordify just mangle. This produced a transcription that sounds 1:1 to my ear. Could totally see myself using this as part of the tools I use to learn music - and I could also see someone eating Chordify's lunch by hooking up a model like this and doing note-level theory analysis in addition to whatever spectral analysis model they're using.
- jardy 1mo agoah, thanks mate. this isn't even their most powerful model - i'd recommend using the Mirelo API to access their most powerful variant or self-host on a GPU.
- chandramoulyKK 1mo agoWow! Perfectly did the whole intro of 'In the end'!
- jardy 1mo agoniceee
- jardy 1mo agosource code: https://github.com/jerryzhou196/pianoify https://github.com/jerryzhou196/pianoify
- mohanz 1mo agoNice!
- Zopieux 1mo agoI'm not sure I get it. This looks like a worse repackage of muscriptor but with a 10s limit, making it useless.
- jardy 1mo agoyou're not wrong. the main problem is the public instance of muscriptor (https://muscriptor.kyutai.org/ https://muscriptor.kyutai.org/) is poorly handled in terms of backend infrastructure, and i often run into errors and rate-limiting. this is just a more niche version of it on my own GPU so the public can use it more.
- bartleeanderson 1mo agoClaude told me all the stuff to rip out and replace with FOSS. Should have been done that way in the first place, but you can't blame a guy for trying to make money these days. Except Trump...