![](//www.4rfv.com/images/no_image.jpg)
Artistry in the Algorithms: Music in the Age of AI Berklee alumni and professors speak to Berklee Today about the promise and peril of making music with AI.
By
Michael Blanding
November 13, 2023
A few months ago, Associate Professor Ben Camp, who teaches in Berklee's Songwriting Department, was working with a recent graduate on a tricky lyric for a new album. She wanted to convey the sense that she could create magic, and to urge listeners to get in touch with their own inner powers instead of being afraid of them, recalls Camp (they/them). And the context for this line was like the mood of the witches that open Macbeth. Later, Camp sent her a potential lyric: In the witching hour's hold / Do you hear the stories told? / Do you fear the magic yet to unfold?
I read it to her and she loved it, says Camp, who says she only changed one word- unfold to unfurl. Camp then revealed that they actually hadn't come up with the line-it was generated by ChatGPT, the large language model trained by artificial intelligence (AI). She was like, Oh my God, I hate you,' Camp says, chuckling.
The anecdote captures the ambivalence songwriters and musicians are feeling about artificial intelligence, says Camp, who has begun introducing ChatGPT and other AI tools into their classes. I've gotten everything from I need to go home and throw out my computer,' to It's okay, but it doesn't have the spirit and soul a human has,' to Thank you for making me use AI. I did a way better job than I would have without it.'
Associate Professor Ben Camp
Image by Kelly Davidson
As generative AI and machine learning get better and better at mimicking human creativity-and at making original music-the technologies have been greeted by musicians and music fans alike with mixed emotions, including a healthy dose of fear. This spring, when an anonymous composer released the song Heart on My Sleeve, claiming they used AI to generate passable versions of the voices of Drake and the Weeknd, the so-called Fake Drake alarmed musicians everywhere, who feared that their talents could simply be ripped off.
It was the second time in a matter of months that AI had crossed the line into what had been exclusively the territory of musicians and songwriters. In February, DJ David Guetta created a song using AI to generate lyrics along with the voice of Eminem. Getting ahead of the trend, in April Grimes gamely told creators they could freely use her voice in compositions without penalty. (That's easy enough when you're a multimillion-dollar artist who has children with the richest man in the world.) So far, such experiments seem little more than musical pranks. But as the technology continues to improve, it's quickly forcing musicians and songwriters, including Berklee faculty and alumni, to grapple with its implications.
These are still early days. But there are a number of startups right now in an arms race to productize AI technology for music that we'll start to see in six months to a year.
- Jonathan Bailey '08, former chief technology officer of iZotope
Democratizing or Dumbing Down? These are still early days, says Jonathan Bailey '08, former chief technology officer of iZotope, a company using machine learning in part to create software for recording, mixing, and mastering music. But there are a number of startups right now in an arms race to productize AI technology for music that we'll start to see in six months to a year. One of iZotope's big breakthroughs was using AI to remove background noise from an audio recording-a feat that is normally hard to do.
Separating out the speech content from noise is really difficult, but it's actually a pretty easy problem to solve using deep learning, Bailey says. The same principles that can label sounds as speech or noise are now being applied to identify drums, guitars, and other instruments-and will eventually be able to generate those sounds, Bailey says.
If you're a singer-songwriter, you can record your voice and guitar in your bedroom and then automatically enhance the quality to sound like you recorded it in a professional studio. Then what if you could add a bass track and drums to that? Right now, it seems in the realm of fantasy, but this could become more and more possible.
In a sense, such technologies are an extension of the democratization of music recording, continuing the trend of software such as GarageBand or Autotune that have made advanced tools more accessible to amateur musicians. It used to cost a million dollars to create an album, then $10,000, and now $1,000, Bailey says. To me, generative AI is just a point on that curve, the next evolution of enabling more people to be creative.
That democratizing trend in AI doesn't bother Mark Simos, an assistant professor in Berklee's Songwriting Department. It's part of a whole progression of technologies to help nonskilled musicians to be able to write songs, he says. That's not likely to fundamentally change the nature of the industry. On the other hand, he does see a danger in professional musicians using AI to generate songs out of whole cloth.
Assistant Professor Mark Simos
Image by Louise Bichan
Decades ago, Simos worked in software with expert systems, a precursor to AI. More recently, he's judged several AI songwriting contests, and has noticed a disturbing trend of musicians using AI as a shortcut to creativity. When you ask ChatGPT to spit out a song on a certain topic in a certain study, that's not how real songwriting works, Simos says. Much of real songwriting is nonlinear; it's not just reaching into some oracular space in your head and out pops the song.
What AI can't replicate-at least not yet-is the combination of music and lyrics that make
More from Berklee
06/09/2024
Student Spotlight: Mateo Londo o The producer talks about leaving Berklee to grieve the passing of a close friend and fellow student and then returning to fin...
05/09/2024
Boston Conservatory Adds a Robust Roster of Artists to Its Faculty Nearly 30 new faculty across the Dance, Music, and Theater divisions bring industry experti...
05/09/2024
Why Music Educators Choose Berklee's Graduate Programs Explore Berklees flexible master's degrees and certificate in music education, and get advice f...
29/08/2024
Berklees Africana Studies Division Launches New Degree Program in Black Music an...
27/08/2024
Berklee's Signature Series Celebrates Brazilian Composers Caetano Veloso and...
23/08/2024
Karen A. Bell Named Chair of Performance Studies The associate dean will expand her responsibilities to manage performance studies courses and oversee departm...
22/08/2024
How Freedom by Beyonc Became a Campaign Anthem Emmett G. Price III discusses the history of political campaign music and what makes Freedom such a versatile ...
21/08/2024
Berklee Announces 2024 Fall Signature Series Lineup This season's performances celebrate musical traditions from country music to the music of Brazil and ...
20/08/2024
Boston Conservatory at Berklee Gets Serious About Clowning With the launch of its newest minor in fall 2024, Boston Conservatory brings circus arts to academi...
20/08/2024
Berklee and Spelman Colleges Student Exchange Program Returns for Fall 2024 The initiative celebrates Black music, culture, and the power of sisterhood.
By
...
09/08/2024
Flora Sullivan Named 2024 Jimmy Lyons Scholarship Recipient The Berkeley, California, native will perform at this year's Monterey Jazz Festival.
By
Cole...
09/08/2024
Leo Luna Roblejo Receives the Latin Grammy Cultural Foundations Sebasti n Yatra ...
09/08/2024
Watch Anita Hill Perform with Boston Conservatory Orchestra at Symphony Hall The attorney, scholar, and civil rights activist narrated the words of Martin Lut...
09/08/2024
Berklee City Music Awards Scholarships at Concert This year, 19 students received scholarships, housing awards, and aid to attend Berklee College of Music.
B...
29/07/2024
Berklee's Music Business/Management Department Hosted Summer Program with Po...
26/07/2024
Berklee Alumni Nominated for 2024 Emmy Awards Twenty-one Berklee alumni received Emmy nominations this year for music composition, sound mixing, and sound editi...
23/07/2024
Alum Notes: Spring/Summer 2024 The most recent news from your fellow alumni.
July 10, 2024
Emily McGuire B.F.A. '18 of Glendale, CA, found a new love f...
18/07/2024
Faculty Notes: Spring/Summer 2024 Recent accomplishments, releases, and events by Berklee faculty.
July 8, 2024
Boston Conservatory at Berklee Assistant Pro...
18/07/2024
Jim McNeely and Miguel Zen n Named the 2024-2025 Ken Pullig Visiting Scholars in...
18/07/2024
Jim Lucchese Named Berklee's Fifth President A 20-year music industry veteran and a committed artist advocate with deep Berklee roots, Lucchese sets the t...
16/07/2024
Dr. Judith Christie McAllister Joins Gospel Performance Summer Program as Artist...
15/07/2024
Berklee Alumni Publications Win CASE Awards The magazine Berklee Today received a gold award and podcast Pass the Mic earned bronze from the Council for Advan...
11/07/2024
Berklee NYC Honors Largest Class of Master Scholars at 2024 Commencement Grammy and Tony Award-winning alum Charlie Rosen delivered the commencement address a...
09/07/2024
Legendary African Musician Youssou N'Dour Receives Honorary Degree at Berkle...
08/07/2024
Berklee City Music Celebrates Three Decades Empowering Young Artists The program has given generations of musicians-sometimes within the same family-the tools...
08/07/2024
Renate Rohlfing Awarded Mass Cultural Council Grant The music therapy faculty member will use the grant to help foster more opportunities to create in-person co...
06/07/2024
Berklee Online Offers Courses to Students in Juvenile Justice Centers To date, Berklee Online classes are offered at nearly 30 such centers across the United ...
06/07/2024
Working to Make Music More Accessible to All New technologies and changing attitudes mean more disabled musicians are playing instruments.
By
Adrian Ananta...
29/06/2024
Students Help Bring Nona Hendryxs Dream Machine to Life at Lincoln Center A group of electronic production and design majors created sonic landscapes for Hend...
28/06/2024
Dr. Trineice Robinson-Martin Named Chair of the Ensemble Department A renowned vocalist, arranger, and educator, Robinson-Martin is known for developing innov...
26/06/2024
LGBTQ Student Group to Hold Inaugural Pride Music Festival Lavanda, founded by student Emma Whitney, will host Camp Fest, an outdoor music festival and commu...
15/06/2024
What Exactly Is Dad Rock? 21 Songs that Explain the Totally Not Embarrassing Gen...
14/06/2024
Dr. Lenora Helm Hammonds Named Dean of the Professional Education Division A renowned jazz vocalist, educator, and Berklee alumna, Hammonds is known for her i...
13/06/2024
Final Exams or NBA Finals? For These Boston Conservatory Students, It's Both Two commercial dance students joined the Boston Celtics dancers for a memorab...
05/06/2024
Taylor Swifts Global Popularity Explained (Berklees Version) Music business, songwriting, and live production faculty weigh in on what makes Taylor Swift unst...
05/06/2024
Professor and Two Alumni Receive Fulbright Awards Faculty member Stacy Mattingly and alumni Shanelle Villegas and Lili Chey Warren have been selected for Fulb...
05/06/2024
Music and Sustainability at Berklee and Beyond Integrating sustainability practices into music not only helps address environmental concerns but also contribute...
24/05/2024
Boston Conservatory Plays a Leading Role at the 41st Annual Elliot Norton Awards With six wins and eight additional nominations, the Conservatory's theate...
22/05/2024
Berklee's Summer in the City Brings Free Concerts to Boston Area The series will feature Berklee students, faculty, and alumni performing at popular venue...
21/05/2024
Dr. Ray Seol Awarded Grant for Creative Individuals from Mass Cultural Council The grant will expand his Seu Aprendiz project designed to help individuals bui...
15/05/2024
Berklee Artists to Perform at Major US Music Festivals this Summer and Fall The Berklee Popular Music Institute arranged placements at top festivals including...
12/05/2024
Berklee Honors Ledisi, Q-Tip, and Gilberto Santa Rosa at Commencement This years honorary doctorate recipients were recognized for their profound influence as...
10/05/2024
Berklee Announces 2024 Songs for Social Change Contest Winners Student songwriters shine in the annual contest that recognizes music with a socially conscious...
10/05/2024
Meet Graduates from Berklees Class of 2024 Members of this years graduating class reflect on their proudest moments at Berklee and look ahead to whats next.
...
10/05/2024
Berklee and Audio Engineering Society to Host Symposium on AI in Music The inaugural AES International Symposium on AI and the Musician will highlight excitin...
08/05/2024
Q&A with Visiting Artist Lei Liang The acclaimed composer discusses his collaboration with Boston Conservatory, his work as a research artist, and what it mea...
04/05/2024
Three Boston Conservatory at Berklee Alums Nominated for Tony Awards An additional eight alums and two current students performed in nominated productions.
...
02/05/2024
Two Boston Conservatory at Berklee Alums Nominated for Tony Awards An additional eight alums and two current students performed in nominated productions.
By...
30/04/2024
Next Jazz Legacy Announces 2024 Cohort of Women and Nonbinary Awardees The program was created by New Music USA and the Berklee Institute of Jazz and Gender J...
27/04/2024
Berklee's Music and Health Institute Launches Community Health Musician Cert...