Cohere has just released a new platform for creating basically AI agents for enterprise, and they have a huge focus on security.
They're doing a couple really interesting new things here.
I got to say Cohere is one of those platforms that I don't talk about a ton.
It felt like their LLM kind of lagged for a while.
They've made some updates. and brought themselves up to be a little bit more competitive now.
And I think that their new AI agent platform is really interesting and basically pushing them back to the front.
So I'm excited to cover them again. I will also say I have a soft spot for them because they are a Canadian company and I am originally Canadian.
I live in America now. So always, always happy to cover a Canadian company.
One funny thing I'll say is I do think their branding is pretty funny.
Their new AI agent platform is called North.
And, you know, of course, they're up north.
So I think that's a pretty good Canadian branding for you.
All right, before we get into this, I wanted to mention if you want to try different models from Cohere or any of the other top AI companies, I have a startup called AIbox.ai.
And basically, I have the top 40 AI models all for a $20 subscription.
You get access to everything on one platform.
And we have a whole bunch of models from Cohere.
We have their R model and their R plus model.
We also have Microsoft, Meta, Quen, NVIDIA, Cohere, Anthropic, OpenAI.
Like we have everybody else as well. A bunch of cool audio and a bunch of image models.
But if you want to try out what's going on with Cohere or any other AI platform, tool, any other AI platform, I'd recommend go checking it out.
There's a link in the description to AIbox.ai.
Yeah, would love to hear what you have to say.
It's currently in beta and we're getting some good reviews and good feedback.
We're constantly working on it. So would love to hear what you have to say about it.
All right. Let's get into what is going on with Cohere.
So the first thing I want to say is obviously these AI agent, these tool platforms, the idea is to automate your workflows, automate things that you're doing.
That's basically what they're doing. I think there's like this concept with agents that at some point we're going to be like, hey, you're a marketing agent, like make my sales go crazy. and uh you you know the agent runs away and pulls off a miraculous miracle i think less and less this is where people are are believing these agents are going to be and more and more it's going to be uh basically giving it tasks to accomplish you figured out how to you know write the perfect newsletter and send it and the whole workflow that goes into that and so you get the you basically train the agent make his automation that can go do that task for you it's kind of interesting because Um, there's two concepts with agents.
One is that they're like an employee. I think right now we're like, we'll get there, I think.
But right now we're not there. I think right now we're at the, uh, a task.
So if an employee does 10 different tasks, you would take one of those tasks and give it to an agent.
That's kind of what we're calling agents now.
I think in the future, it's going to be the agents, like an employee that can do all your things you train it to do.
But in any case, I digress. So what I will say is basically one of the big problems with agents that companies have is that they are not very secure.
You're giving it your private data and people don't really know where that all leads or goes.
There's been a whole bunch of leaks, things like that.
And so Cohere is basically trying to address that concern and keep their customers' data private.
Who are they working with? We're working with big banks, RBC Bank, and a bunch of other financial places and those kind of places, a lot of enterprise and white collar.
So... Basically, they are promising to enable private deployment so that enterprises and governments can keep their customers' data safe and behind their own firewalls, right?
So this isn't a deployment where you're accessing their API.
This is going to be on your own servers, your own firewalls, protected.
And that's kind of what Cohere is. Basically, I think it's the angle they're taking so that they can stay competitive in the market.
This is what they said. This is a co-founder, Nick Frost of Frost.
That's the greatest last name of a Canadian.
I love that. He's a co-founder of Cohere.
He said, LLMs are only as good as the data they have access to.
If we want LLMs to be as useful as possible, they have to have access to useful data, and that means they need to be deployed in the customer's environment.
He's kind of referencing the fact that if these companies want this to be really useful, you need to deploy them on your own servers, give them access to all of your company data, and And then when you ask it questions, it's actually looking at your data to give you results and responses.
It's very customized and it's stuff that you can't obviously get publicly on something like ChatGPT.
So instead of using enterprise cloud platforms like Azure or AWS, you can actually install North. on your organization's private infrastructure so that it never sees or interacts with your customer's data.
North can run on an organization's on-premise infrastructure, their hybrid cloud, their VPCs, or air-gapped environments.
So this is pretty cool. He said, quote, we can deploy literally on a GPU in a closet that they might have somewhere.
Basically, they claim that they also include security protocols like granular access control, agent autonomy policies, continuous red teaming, and third-party security tests.
So basically, it meets international compliance, GDPR, SOC 2, ISO 27001.
I'm not sure what country that is required by.
And I'm sure some people are yelling at me that it's like a super common thing I just wasn't aware of.
But in any case, this is pretty exciting.
So far, Cochere, by the way, has a background on the company.
They've raised about $970 million. Most recently, they had a $5.5 billion valuation.
So they're growing. They're still cruising along.
They said that they already piloted North with a bunch of customers.
So RBC, Dell, LG, Ensemble Health Partners, and also Palantir.
So there's some big players that are using this.
It is a cool tool. It basically mirrors many AI agent platforms right out of the box.
Its main feature is chat and search, which basically lets you get answers to your customer support queries.
You can summarize meeting transcripts. You can write marketing copy.
You can access information from internal resources and the web.
So these are things that we have seen other places, but they're also basically trying to make this more focused on the enterprise and what they're doing in-house and not giving it like access to, you know, they're not running this on their own server.
You're running this on your personal company server.
It also has citations and quote-unquote reasoning chain of thought.
So an employee could audit or verify the output that is actually there, right?
It will show the steps that it went through to get an answer.
So if you're saying like, hey, you know, which customers in our database had the most problematic transactions.
It would give you a list, and then you can go look through how it actually came to that conclusion, right?
So I think this is really interesting. The chat and search function are basically powered by Code here.
They have their own LLM model, which you go try on AI Box if you're curious on how that works and what it looks like.
Command. They have a bunch of generative AI models.
Compass is its multimodal search tech stack that they've created.
It's so funny. I love this. Compass North.
This is great. This is very, very Canadian.
So this is what they said about it. They said it goes beyond just Q&A and gets into doing work for you.
North has a bunch of asset creation. It can make tables.
It can make documents. It can make slideshows.
A bunch of market research. Or it can do a bunch of market research.
I think it is worth noting that Cohere actually acquired a company back in May called Autogrid.
So this was a Vancouver-based company. And basically, they develop enterprise tools for automating high-level market research.
So I think this is kind of cool that they went and acquired a company and basically used that to kind of push themselves forward and become more competitive for their their customers.
Like a lot of AI agent platforms, it can connect to existing workplace tools.
So things like Gmail, Slack, Salesforce, Outlook, all of those, it can integrate with all of them.
It also integrates with MCP, model context protocol servers to basically access a bunch of industry specific or in-house applications that a company might have.
And this is a final quote from their co-founder and CEO, Mr. Frost himself from Canada.
He said, as you build confidence by chatting to the model, there is like a smooth transition that happens between using this as an augmentation to using it as an automation.
All right. Will you completely automate everything in your life with this platform?
I will say probably not for now. I think this is probably a really useful tool, especially for companies.
I don't think it's competitive as a standalone product.
This is my critical after giving them their praises for their clever names and being Canadian.
But I don't think this is actually a super competitive product as a standalone product.
And I think this is evidenced by the fact that they're not competing head on with OpenAI and a lot of other players trying to have like the best model.
They're basically trying to say, look, we have a really decent model and we have a whole bunch of really great tools for enterprise to use.
Is this a bad approach? Not at all. I think this is a great approach.
They're solving a problem that people have.
I just don't think it's like, it's not something that everyone has to use or try because it's probably not number one.
Now, is it good at certain tasks? Better at maybe tone or better at style or better at doing different things?
Yeah, I think it is. But I also think it's probably getting most of its lift and usage.
It's most of its valuation based on the software tools that have been basically built around their LLM.
And I think it almost calls into question, unless they're about to train and release like some new insane LLM, they're not number one.
And so it calls into question, in my opinion, when you have OpenAI dropping like an open model, like they just dropped yesterday.
It almost calls into question, like what if any company went and took that open model, ran it themselves and built all the tools that Cohere has and competed with them without having to train their own model.
It's kind of interesting. So I think Cohere is going to have to spend more investment to make sure their model is up to par and is kind of top notch.
I haven't seen any big announcements from them since, uh, since their last model, which was a while back.
So I'll be curious to see where they go.
They are an interesting company. I think they're making some good moves, but I don't think it's the number one company at the moment.
Thank you so much for tuning into the podcast.
I hope you learned something new about basically how you can take a model, take a tool that might not be number one and still get an incredible $5 billion valuation out of it.
It's basically with making partnerships and making tools that address specific user needs.
Thanks so much for tuning in. Make sure to leave a rating or review wherever you get your podcast if this was useful to you.
And go check out AI Box, aibox.ai. There's a link in the description.
You can try out Cohere for yourself and 40 other AI models that should save you a ton of money.
It's 20 bucks. All right, you have a great day and I'll catch you in the next episode.
