https://kyutai.org/blog/2026-07-10-muscriptor/ says
We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with Mirelo. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.
embedding-shape 2 days ago [-]
Woah, that's much more interesting, as it seems to handle more than just the lead instrument/piano, as this Show HN does. Thanks for sharing that, very useful!
fweimer 3 days ago [-]
I wonder what the intent is behind releasing the weights under a CC-BY-NC license. Is it about restricting any commercial use of the weights, including for inference?
jardy 3 days ago [-]
absolutely - thanks for the reference.
epiccoleman 3 days ago [-]
Wow, this works way better than I expected. Fed it "Shimmer and Out" by Lotus, the intro of which is just a pretty simple guitar riff based around triad shapes - but it's the kind of thing I've seen Chordify just mangle. This produced a transcription that sounds 1:1 to my ear.
Could totally see myself using this as part of the tools I use to learn music - and I could also see someone eating Chordify's lunch by hooking up a model like this and doing note-level theory analysis in addition to whatever spectral analysis model they're using.
jardy 3 days ago [-]
ah, thanks mate. this isn't even their most powerful model - i'd recommend using the Mirelo API to access their most powerful variant or self-host on a GPU.
I'm not sure I get it. This looks like a worse repackage of muscriptor but with a 10s limit, making it useless.
jardy 2 days ago [-]
you're not wrong. the main problem is the public instance of muscriptor (https://muscriptor.kyutai.org/) is poorly handled in terms of backend infrastructure, and i often run into errors and rate-limiting. this is just a more niche version of it on my own GPU so the public can use it more.
chandramoulyKK 3 days ago [-]
Wow! Perfectly did the whole intro of 'In the end'!
jardy 3 days ago [-]
niceee
bartleeanderson 2 days ago [-]
Claude told me all the stuff to rip out and replace with FOSS. Should have been done that way in the first place, but you can't blame a guy for trying to make money these days. Except Trump...
Rendered at 23:20:55 GMT+0000 (Coordinated Universal Time) with Vercel.
https://kyutai.org/blog/2026-07-10-muscriptor/ says We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with Mirelo. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.
Could totally see myself using this as part of the tools I use to learn music - and I could also see someone eating Chordify's lunch by hooking up a model like this and doing note-level theory analysis in addition to whatever spectral analysis model they're using.