Machine learning lets computer create melodies to fit any lyrics
Got words but no melody? A machine learning system turns poetry into song by composing a pop music score to suit the lyrics it’s given.
“I was studying singing while I was doing my PhD in computer science,” says Margareta Ackerman at San Jose State University in California, who developed the system with David Loker at technology advisory firm Orbitwerks. “Over time, I started to think of computers as creative partners instead of tools, which could maybe help me write songs.”
The system, called ALYSIA, processes short lines of text and associates each syllable with a musical note. It chooses the pairing based on features including the syllable’s position in the word and how it will fit with the previous five notes.
ALYSIA can write whole accompanying scores this way, or provide musicians with a variety of melody options for each segment of lyrics, acting like a co-creator. Ackerman and Loker developed the system to produce pop tunes, but say it could be adapted different genres. The system uses two models, one focused on rhythm and the other on pitch. These were trained on the melody line and lyrics of 24 different pop songs.
They then used the system to make melodies to accompany two sets of words written by Ackerman that involved it coming up with tunes for lyrics such as “Now that you’re gone / I just realised that I’m all alone”. They also fed it the lyrics to the vaudeville classic I’m Always Chasing Rainbows to see how it could reimagine the song in the pop genre.
https://www.newscientist.com/article/2115684-machine-learning-lets-computer-create-melodies-to-fit-any-lyrics/
Bob Dylan should have had the above machine.
Also "Deep-Learning Machine Listens to Bach, Then Writes Its Own Music in the Same Style"
https://www.technologyreview.com/s/603137/deep-learning-machine-listens-to-bach-then-writes-its-own-music-in-the-same-style/
Between the two, you should be able to take Bob Dylan's lyrics and set them to a Bach cantata!
= new reply since forum marked as read
