Eleven Labs has just released an API for their music generator.
And this is something absolutely no one is talking about.
And I am super excited. So today on the podcast, I'm going to tell you why and also exactly where I think we're going to start seeing this implemented into tons of software that we use today.
Overall, I'm excited. I'm a music enthusiast, so As you know, this is a good one for me.
Before we get into that, I wanted to mention, if you want to try all of the models that we talk about, on the podcast, I'd love for you to check out AIbox.ai.
This is my own AI platform that's currently in beta.
We give you access to the top 40 different AI models for 20 bucks a month.
Cloud, OpenAI, Google, and dozens more 11 labs for audio generation, a bunch of cool image generation models.
20 bucks a month and you get access to all of it.
So go check it out. AI box.ai. There is a link in the description.
Let's get into what Eleven Labs has announced today. um a bunch of this is coming from their twitter they recently had like an x thread They said interest in the 11 labs music API.
This is the first music API Okay, this is why I'm excited about it.
Personally, I'm actually someone that has used a ton of different image generator or audio music generation models.
The number one model that I typically use is Suno AI.
It's specifically for music. It does a bunch of cool stuff. and I have used this.
I've released full albums on Spotify. They get thousands of daily streams uh with ai music i know i know it's like controversial some music artists will come at me i put my own special touch there's all sorts of cool things you can do with suno for example if you think think of a song You can hum a tune into it, and then you can say basically the style.
You want this to be a folk song, and it will generate it.
You can add lyrics, or you can do instrumentals, which is what I typically do a lot.
I'm not an amazing a vocalist. And so, yeah, you can do all sorts of cool things and make them really your own.
So anyways, that's what I've typically used.
Now, The problem is it is just a consumer tool.
There is no API. You can't tie this into a platform or a software or tool. and so really it kind of limits the reach unless you're signing up on their actual website you're not going to be able to basically get the capabilities everywhere else that has all sorts of interesting use cases, which I'll talk about.
So 11 labs has changed that one of the number one audio platforms of all time is 11 labs for creating vocal or for, you know, voices and reading and just basically audio.
And now they've added music just recently, they added their music.
And so they've added now the API, which is really cool.
I was actually excited when I saw the music thing.
Um, It was the first time I was like, oh, I should probably look at something other than Suno because the quality on it looked really good.
And then of course, now that it has an API, it like, honestly, it's possible to jumpstart Suno It's kind of crazy to think about mid-journey was like the number one image generator image generator for like a long time.
Um, and I almost never hear anyone talk about it anymore that quality might be good but like the use is going to be super small because they basically lock themselves inside of discord for a long time And the number one thing that I think is a problem is that they've never allowed an API.
So something like Mion, on AIbox.ai, my own platform.
I have OpenAI's image newest image generation model because they release an api and we get thousands of images generated from people that want to try that out and use it there.
And there's no way for me to add discord without doing like a shady third party API, which could get broken and just basically no software companies are going to touch it without an API and most of them can't.
So anyways, This is really exciting. They said you can now integrate the highest quality into your products and workflows.
Since launch, creators have generated over 750,000 songs with 11 laps music.
This just came out like less than a month ago, I want to say. um and yeah this is impressive almost a million songs have been generated since it happened I am not surprised Eleven Labs has a huge user base and now now that they basically have this API, I expect to see that number explode.
So honestly, something I'm really excited about.
This is what they specifically said. They said the 11 labs Music API allows you to generate high quality tracks from a text prompt.
And the reason I'm bringing this up is because like when an API comes out, it kind of makes sense for something like chat.
ChatGPT API, you ask it questions, it responds.
But when you do like music or video or even images, Like there's a whole bunch of capabilities that sometimes the foundational components like the company that created it have, but they don't always move over to the API.
So they outline basically what you're able to do with the API.
Suno, for example, lets you hum a tune and it will change it into a song but if they had an api i would assume like a feature like that wouldn't get ported over not necessarily uh you know, for sure.
But things like that don't typically or maybe they come later in any case.
So This is kind of what 11 labs is outlining.
So they basically let you put in a prompt, generates a tract, You can create vocals or instrumental versions of any genre or in any genre, which is really cool. you can customize the length structure and the language.
So they do have a whole bunch of really interesting settings there.
And basically all of these settings are what you can expect in a whole bunch of different software coming soon.
And they've announced specific partnerships they have already made basically who they use to test and create this API, which I thought was cool.
So they said, This is created in collaboration with labels, publishers, and artists.
Songs were created with Eleven Labs Music API are available for broadcast. commercial use.
Again, amazing because of all of the lawsuits with Suno and Yudio.
And basically, Suno and Yudio, if you have their paid plan, they say you can use it for commercial use. they have like lawsuits based off of their training data with, I think like different record labels and stuff.
But I think that's, kind of going to fall on them.
They say it's good for commercial use. So I think basically you can use it.
But Eleven Labs is actually going quite a step further, when they did their training data, I noticed one of my distributors that I use is called And inside of Lander, there was this pop-up that came, I want to say six months ago, maybe even a year ago, which basically started saying like, Hey,
Would you like to opt in to have your music included into AI training?
We will compensate you for it, basically.
And some artists I said yes, some artists I said no on this.
And it's interesting because basically when I saw this, I was like, OK, cool, I
I thought maybe it was Suno or Yudio that were trying to like, a lot of these AI companies that like train on, data they weren't allowed to and then they go back and try to like get licensing for data and do a retrain.
And then when the lawsuits are all happening, they're like, oh, look, whatever.
We just... We retrained and now we've got the good data anyway.
So this is kind of isn't important. Let's move past it.
I feel like that's kind of like opening eye in the New York Times.
That's kind of like a strategy. So I thought that was, I was assuming that was the, what was happening, but actually beyond land or just building another revenue stream for themselves, 11 labs, I'm assuming, probably even contacted Lander and a lot of the distributors to try to work out these deals, make that pop up show up because Landers data they did confirm was in bedded in this model.
And all those people are opting in. So it's like, know for anyone that's like oh you know these ai models are training off of people's music and then They're replacing artists and stuff.
Well, if you're using something from Eleven Labs, all of these artists have opted in and they're getting compensated.
So my mind like this is 0% controversial and just a new revenue stream for artists.
Okay. They said it's designed for building apps across media and entertainment.
Whether you're delivering personalized meditations, producing music for video games or creating AI generated ads.
Over the past weeks, we worked closely with partners like VEED, AMP, and Hedra Labs to build the 11 like api okay i want to talk about their partners but first i got to talk about a very funny element.
And that is a fact that they said based off of One of the one of like the startup use cases they mentioned here was personalized meditations. which is interesting because a lot of distributors, Lender in particular, who has this partnership, giving them data, actually don't allow you to release like meditation music onto Spotify.
Some people do, some people don't. Lander specifically doesn't, which is interesting because basically Lander's data was used And then the use case that they're recommending, you can actually publish on Spotify.
But I guess if you're just doing software... like on inside of an application, then you can do it.
So anyways, kind of interesting. thing.
So they made a bunch of partners. The one that I'm the most excited about, they have AMP. they have hedger labs hedger basically does videos which is really really cool they have a a demo where basically it's like a woman singing an 80s song and so Hedra makes the video of the woman singing, but now they actually have the song to go with it.
And it's lip syncing. up with the video that is very very cool for me in my opinion um moving beyond just making videos.
Now you're actually making a music video, which is crazy.
Another one of their partnerships, which I think is pretty big is with Veed.
Veed is, you know, this huge, um, video generation tool.
It's sponsored like A lot of podcasts, a couple of years ago, I think it sponsored the This Week in Startups podcast.
And so like, I just know Veed. has been shilled to me like over 100 episodes that I've listened to.
But it's actually a great video editing platform.
I think it's basically a competitor to CapCut, kind of like Canva for video, I think.
In any case, it has a ton of users. And so one of the big use cases that they're saying people are gonna be using it for is ai background music right so if you're generating if you're making um a video, which is something that I personally have experienced a lot where I'm generating like some sort of video or editing a video for some like a YouTube project is, you know, I used to have a YouTube channel where I'd put out weekly YouTube content.
Before I had an editor and you know, people that helped with the production on my podcast.
And yeah, I remember this was a huge thing that would take me so much time basically whenever I wanted like some B roll and want to put music in the background, I go to like YouTube has this like free music library place and like you can like search through and like pick different songs and it would take I'm ashamed to say I would sometimes spend an hour finding like the right music for my video because I'd just be listening to it.
And like. you know, if you had a good song, you just kind of like use it over and over again.
You'll notice just like Mr. Beast. Mr. Beast or Mark Rober, like Mark Rober has the same song and all of his B roll.
And he probably got that custom made so that he doesn't have to pay licensing for it.
So that's probably one element of it. but also then he doesn't have to sit there and think about what the newest B-roll song is gonna be.
Anyways, I think this basically solves that problem where you're generating...
You're creating and editing a video, and now you can generate music in the background.
You just describe the style that you want.
Basically, they say you can create a custom track.
AI analyzes your videos transcripts to generate a track that perfectly matches the subject and tone of your content to me that is Very cool.
You don't have to explain what you want.
You just say, Hey, generate like music here.
It's going to look at the transcripts of your whole video.
And it's like, okay, basically it's. a song like xyz now i wonder if i i'm hoping you can switch actually They did say in their API you have the ability to switch between making it an instrumental or with vocals, but either way, very, very cool option.
This had to showcase the power of 11 music in our API.
Our team also built... JingleMaker, a tool to create songs based on your ex profile or website in just two clicks.
This is actually really funny. They got the website JingleMaker.ai.
And I think that more companies should 100% do this.
And basically, if you go to JingleMaker.ai, which I did and tested out because I thought this was hilarious.
You can put a website or you can put your your Profiling now the one thing I'll say is the it's sort of like misleading on how it happened is using your own profile but basically the way they explain it is like you upload the link to your your Twitter account, your ex profile.
And it's going to make like a song. Now my assumption was, it's going to be like a song about me based off my content I did that but it just made a song about like X in general so I don't think it like actually looked at the full URL
Anyways, whatever I'll forgive them for it was pretty funny.
It was a good song and You can make a whole bunch of different styles of music.
And it's a very simple website. You basically can make a radio ad. a Midwest farmer, a, a rap, uh, drama trailer, uh, us politician style, uh, song, whatever.
So like, there's all these like funny things that you can basically make.
Now, I think more companies should do this because basically they're displaying, like they're showing, look, here's a new product and we've embedded the API in here and here's how it works.
And they make this kind of viral loop where if it actually, okay, It would be more viral if you could actually make a song about your personal profile and then you'd probably think it's really funny and post it.
Unfortunately, it doesn't look like that actually works.
So I imagine the viral the virality of that is not going to hit the way they hope. unless they fix that.
I don't know. But in any case, I think this is genius.
Make a viral loop. with a product that's super funny.
And it basically shows off what your product is capable of.
I think more companies should do this. So I was excited.
They said their API is available at 50% off this month.
So if you want to start, try using it now, it's gonna be 50% off.
And yeah, I think this is amazing. Really, really cool tool.
11 Labs is... you know, the leader in voice.
So it's cool to see them getting in more with actually making music, which is a growing industry.
Anyways, thank you so much for tuning in to the AI Chat podcast.
If you enjoyed the episode today, Make sure to leave a rating and review wherever you get your episodes.
And also make sure to go check out AIbox.ai if you want to try all of the AI models I talk about on the show in one place.
For one subscription price, you don't have to have subscriptions to 10 different platforms.
You get them all on the AI Box website.
Thanks so much for tuning in, and I will catch you in the next episode.
