If you have already played with ChatGPT, you know how awesome (and terrifying) AI can be. ChatGPT can generate just about anything you ask of it, with prompts as simple or as complex as you can imagine. Well, Google figured out how to do the same. But rather than spitting out poems or computer programs, Google’s AI writes music, and you can preview its creations right now.
Google’s AI, dubbed MusicLM, is designed to produce several minutes of high-quality music based on text prompts. While AI music isn’t necessarily new, the company says its program produces more accurate tracks compared to the initial text prompt. and are of better quality than previous models. Big claims, of course. But, based on these insightsthey might just be up to it.
The first batch shows how MusicLM can generate music from rich subtitles, similar to how OpenAI’s ChatGPT generates its famous responses from user requests. Google may provide MusicLM with a caption, such as, “The soundtrack to an arcade game. It’s fast and upbeat, with a catchy electric guitar riff. The music is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls. drum”, and the AI will process a track that meets those criteria.
My favorite from this section is the song generated from “Funky piece with a strong, danceable beat and a prominent bass line. A catchy melody from a keyboard adds a layer of richness and complexity to the song” on the second page, which sounds like something Stardew Valley.
where the strange valley really installs, however, whenever Google asks MusicLM to produce vocals. Many of the Google examples here have AI voices, and while some of them sound “IT” for lack of a better word, others sound a little too close to home. When you listen knowing that the voice is 100% artificial, it’s a little destabilizing. Google even had MusicLM generate a rap track, and, to be honest, the “rap” is weirdly realistic, even though none of the words they rap are real.
G/O Media may receive a commission
The Lyma Supplement
10 ingredients. One super-supplement.
Lyma makes the next generation of supplements—peer-reviewed and formulated to unlock your potential.
If you really want to be creeped out, scroll down to the “Text and Melody Conditioning.” Here, you can hear a series of voices and instruments doing their best with different melodies, and the results are wild. The very first option sees MusicLM humming “Bella Ciao,” and it sounds way too good. Side note: The “Tribal drums and flute” version is giving White Lotus.
We also have “Long Generation,” which produces five-minute long tracks from short descriptions, like “melodic techno” or “relaxing jazz.” But things get really interesting with “Story Mode.” Google feeds MusicML multiple captions, and the AI adjusts the song based on the given caption. It starts with 15 seconds based on “time to meditate,” before the caption switches to “time to wake up.” The music smoothly changes in tune, as if it was starting up a new verse, with some creepy vocals to boot.
Creepy vocals aside, it’s fascinating to see the AI alter the song without having to change the song. For the most part, it incorporates the new caption into the song, without feeling like you’re jumping into a new tune altogether. It’s particularly impressive with the third example, which sees the AI jump from “pop song” to “rock song” to “death metal song.” While “rock song” doesn’t particularly sound like rock, “death metal song” is simply fantastic. I imagine AI Death will be a big hit with metal heads.
Another interesting experiment Google did was feed MusicLM descriptions of famous paintings to see what music it would produce. If you ever wanted to know what Vincent Van Gogh’s “The Starry Night” would sound like as a song, well, now’s your chance. It’s also fascinating to click through how MusicLM generates specific instrument and genre sounds. The electric guitar is on point, as is “British Indie Rock,” complete with a dramatic turn at the end of the preview.
There’s more to explore from this limited preview of MusicLM, too, from “Accordion Solos” to comparing different results from the same prompt. Google also published a 15 search pages on MusicLM, if you want to read the technical details of the system. While I hope the company releases a beta for the public to try out, browsing these samples is the best thing to do.