Hi!
The progress in AI has exploded the last year, first with Dall-E, Midjourney, Stable Diffusion etc. to ChatGPT. This makes me wonder if any of you have knowledge to what/if there is anything released (or in beta; closed or open) regarding AI and recognition of sheet music? I have been using PDFtoMusic Pro and ScanScore for years, but the results varies tremendously from input. (...I don't have hopes for recognition of handwritten scores in any forseeingly future, though.)
Kind regards,
Magne
Artificial Intelligence to convert flat pdf's to MusicXML
Moderators: Peter Thomsen, miker
-
- Posts: 69
- Joined: Sat Dec 10, 2016 9:02 pm
- Finale Version: Finale 25.5
- Operating System: Windows
No knowledge of what's happening, artificial or otherwise. I use SmartScore and it does a good job but it is dependent on the quality of the original input. I think this is where AI could be of benefit, take a handwritten score or a marginal printed score and produce a high quality original that could then be processed.
AI is likely to impact on the entire read and convert process but just how quickly is the unknown since it is a small niche market compared to more general uses.
AI is likely to impact on the entire read and convert process but just how quickly is the unknown since it is a small niche market compared to more general uses.
Finale 25.5
SmartScore 64
JABB3
Windows 11
SmartScore 64
JABB3
Windows 11
-
- Posts: 1325
- Joined: Fri Aug 20, 2010 8:59 am
- Finale Version: Finale 27
- Operating System: Mac
There's this recent podcast on Scoring Notes about using Machine Learning in OMR (optical Music Recognition.)
https://www.scoringnotes.com/podcast/fr ... -to-slice/
There are a fair few academic papers on the subject; and there are several OMR github projects, in various states, some of which use Machine Learning. Lots of apps claim to use AI for turning audio into notation.
And once that's done, it won't be long before you can feed an AI the corpus of mid-century European plate engraving, and then say "here's some notation -- engrave it like that." And get it done in 5 seconds.
When we're on the brink of technology of that sort, some of Finale's processes seems like Tudor re-enactment!
https://www.scoringnotes.com/podcast/fr ... -to-slice/
There are a fair few academic papers on the subject; and there are several OMR github projects, in various states, some of which use Machine Learning. Lots of apps claim to use AI for turning audio into notation.
And once that's done, it won't be long before you can feed an AI the corpus of mid-century European plate engraving, and then say "here's some notation -- engrave it like that." And get it done in 5 seconds.
When we're on the brink of technology of that sort, some of Finale's processes seems like Tudor re-enactment!
But what about the part where AI seeks out and kills any Composers still out there
and writes its own Music, intended for other AI Units, Prints ( hmmm, maybe not needed...) and Records,
no need for people.
Maybe just to keep the Electricity on and functioning.
I was always hoping for the Version of Finale where I put a few electrodes in place before going to bed,
and VIOLA!
Stacks of printed Scores and Parts, ready to go in the morning.
I'd rather use Regular Intelligence to write some Artificial Music.
Whatever That means!
and writes its own Music, intended for other AI Units, Prints ( hmmm, maybe not needed...) and Records,
no need for people.
Maybe just to keep the Electricity on and functioning.
I was always hoping for the Version of Finale where I put a few electrodes in place before going to bed,
and VIOLA!
Stacks of printed Scores and Parts, ready to go in the morning.
I'd rather use Regular Intelligence to write some Artificial Music.
Whatever That means!
- motet
- Posts: 8412
- Joined: Tue Dec 06, 2016 8:33 pm
- Finale Version: 2014.5,2011,2005,27
- Operating System: Windows
The current AI stuff in the news has to do with mining huge quantities of text posted on the internet for information and language patterns. I'm not sure how useful that is to music recognition. I do think that software can eventually replace music engravers. There's been progress there (e.g. Finale to Dorico) but as we see it's got a long way to go, so no need to worry yet. I also think software can eventually replace what I do, which is arranging. As far as composing, I'm not so sure.
- John Ruggero
- Posts: 830
- Joined: Tue Dec 06, 2016 11:41 am
- Finale Version: Finale 25.5
- Operating System: Mac
The last few years have shown that we humans have a very tenuous grip on fact vs. fantasy and won't be able to deal with a reality created by AI. AI could be a disaster for those who find meaning in making things, but those who spend their lives taking won't be troubled.
2020 M1 Mac mini (OS 12.6) Finale 25.5 and 27, Dorico, Affinity Publisher, SmartScore 64 Pro, JW Plug-ins, TG Tools, Keyboard Maestro
www.cantilenapress.com
"The better the composer, the better the notation."
www.cantilenapress.com
"The better the composer, the better the notation."