So that's my advice is every day, every day, you should be in ChatGPT.
I don't care what your job is, right?
You could be a sommelier at a restaurant and you should be using ChatGPT every day to make yourself better at whatever it is you do.
Can I ask you about the story really quick?
And you have like a list of stuff here that's like all amazing.
It's actually a lot of it's very actionable.
But the reason I want to ask you about the story is for the listener.
center, Dharmesh founded HubSpot, $30 billion company.
You're the CTO. So you and you're an OG for web 1 .0, web 2 .0.
And your first round or one of your first rounds was funded by Sequoia.
Your partner, Brian, is an investor at Sequoia.
So you are in the insider.
You're an insider, I believe.
You may not acknowledge it.
I don't know if you do or do not.
You are an insider.
The cool part is that you're accessible to us.
When did you first see what Sam was working on?
and how long have you felt that this is going to change everything so i actually have um known sam before i started open ai and i got access to um the gpt api it was a toolkit for developers to be able to kind of build ai applications right effectively um and so i built this little chat application that used the api and so i could have a conversation with him so i actually built that that thing uh that night uh it was it was a sunday i had the full transcript two years before chat gpt came out so that's four years ago uh it was 2020 so five years ago wow okay uh this summer and so even then it's
like and like as soon as i like you sort of have that moment it's the same that all of us have with chat gpt i just had it two two years earlier and then i'm showing everyone like brian you are not going to believe like i have this thing you know through this company called open ai and watch me like type stuff into it and see like see what happens it it's and we would ask it like strategic questions about hubspot it's like how should it like who are the top competitor like and they were even then two years before chat it was shockingly good right but the thing you sort of have to understand about the constraints
of how a large language model actually works is that you type and you have a limited just imagine this if we're going to just use the uh physical analog uh their sheet of paper can only fit a certain number of words on it and that certain number of words includes both what you write on it that says i want you to do this and the response has to fit on that sheet of paper and that sheet of paper is what in technical terms would be called the context window and you'll hear this tossed around it's like oh this you know chat gpt has a context window of whatever or this model has a context window whatever
that's what they're talking about all right so why is that why does anybody care care about the context window, it's like, well, sometimes you want to provide a large piece of text and say, summarize this for me.
Well, in order for you to do that, it has to fit in the context window.
So if you want to take two books worth of information and say, yeah, I want you to summarize this in 50 words, those two books worth of information have to fit inside the context window in order for the L and the process.
The frontier models are roughly 100 ,000 to 200 ,000.
And they measured in tokens, which is like 0 .75 of a word. But...
That's like a book.
So yeah, is that a book?
I think it's an average.
I think the average book is like 240 ,000 words, I think.
But I'm not sure. That's not a lot.
The way that I use ChatGPT is, let's say, fun ways.
I'll put a historical book that I loved reading, and I'll be like, summarize this so I remember the details.
So you're telling me that if it's a 1 ,000 -page book, it's not even going to accurately summarize that book?
It won't fit. it. If you paste something large enough into ChatGPT or whatever AI application you're using, it will come back and say, sorry, that doesn't fit.
Effectively, what they're saying is that does not fit in the context window.
So, you're gonna have to do something different.
All right. A few episodes ago, I talked about something and I got thousands of messages asking me to go deeper and to explain.
And that's what I'm about to do.
So, I told you guys how I use use ChatGPT as a life coach or a thought partner.
And what I did was I uploaded all types of amazing information.
So I uploaded my personal finances, my net worth, my goals, different books that I like, issues going on in my personal life and businesses.
I uploaded so much information.
And so the output is that I have this GPT that I can ask questions that I'm having issues with in my life.
Like, how should I respond to this email?
What's the right decision, decision knowing that you know my goals for the future, things like that.
And so I worked with HubSpot to put together a step -by -step process showing the audience, showing you the software that I use to make this, the information that I had ChatGPT ask me, all this stuff.
So it's super easy for you to use.
And like I said, I use this like 10 or 20 times a day.
It's literally changed my life.
And so if you want that, it's free.
There's a link below.
Just click it, enter your email, and we will send you everything you need to know to set this up in just about 20 minutes.
And I'll show you how I use it.
Again, 10 to 20 times a day.
All right, so check it out.
The link is below in the description.
Back to the episode.
I usually use projects and I have like, let's say a health project.
And I'll upload tons and tons of books or tons of blood, blood work.
And I hope I'm hoping that it's going to pull from all those books in my project.
Is that true? That that is true.
So here and this is a perfect segue, right?
Because this is the next big unlock.
So number one thing to like understand in our our heads is there's this thing called a context window.
Here's why it matters.
So let's, we're going to take a, we're going to pop that on the stack and we're going to push down the stack and we're going to come back to it.
So the thing we have to remember is two things.
Number one, it doesn't know what it's never been trained on.
That's one of the limitations, right?
So if you ask it something that only you, Sam, have in your files, in your email, wherever that the training model was, I mean, the LLM was never trained on, it's not going to know those things.
It doesn't no matter how smart it is it's just information it's never seen so it's not gonna know that that's kind of problem number one problem number two so let's say your website for hampton was actually on um uh in the training set right because it's on the public internet or whatever but the training happened at a particular point in time like they ran the training ran the training ran the training and said okay we're done with the training now the machine is done let's let let the customers in, right?
Now, if the website changes, it's not going to know about those new updates that you've made to your website because the training was done at a particular date.
If completed, it's kind of training course, right?
So those are two things we sort of have to remember is that it doesn't know what it doesn't know.
And number two, that the things it did know were frozen at that particular point in time, right?
So it hasn't seen new information.
And those are relatively large limitations, right?
So especially if you're going to use it for business use or personal, it's like, well, I've got a bunch of stuff that I wanted to be able to to answer questions about or whatever inside my company or inside my own personal life.
How do I get it to do that?
And so here's the hack.
And this was a brilliant, brilliant discovery.
So what they figured out is to say, OK, let's say you have 100 ,000 documents that were never on the internet.
That's in your company.
It's all your employee hiring practices, your model.
Here's how we do compensation.
All of it, right? It's like, oh, you have 100 ,000 documents.
And obviously, you can't ask questions about those 100 ,000 documents straight to chat GPT.
He doesn't know anything about those, never seen those documents.
So this is, and we talked about this two episodes ago, this thing called vector embeddings and RAG, retrieval augmented generation.
And I recommend you folks go listen to that.
I think it's a fun episode, but I'll kind of summarize it, which is what you can do.
And what we do is to say, we're gonna take those 100 ,000 documents and we're gonna put them in this special database called a vector store, a vector database.
And what we can do now is when someone asks a question, we can go to the vector store, not the LLM, go to the vector store and say give me the five documents out of the hundred thousand that are most likely to answer this question based on the meaning of the question not keywords based on the actual meaning of the question so it's called a semantic search is what the vector store is doing so it comes back with five documents let's just say now as it turns out five documents do fit inside the context window so effectively we said okay well yeah it would have been nice had you trained on the hundred
thousand documents but that was not practical because i didn't want to expose expose all of that.
I'm going to give you the five documents that you actually need.
I can just say, give it to you in the context window.
And now, as you can imagine, it does an exceptionally good job at answering the question when it knows the five documents that should be looking.
You just gave it to them, right?
So it's having this, so we'll kind of jump metaphors here.
It's like hiring a really, really good intern that has a PhD in everything, right?
They went to school, they read all the things, read all the internet.
The intern knows everything about everything that ever was publicly accessible.
They're trained, show up for the first day of work.
That's all they know.
They're not learning anything new and they know nothing about your business.
Now it's like, okay, well, I know you know everything about everything.
I have this question about my business.
Here are five documents that you can read right now and answer my question.
Just like, oh, I can do that.
I like that analogy, the intern with the PhD and everything.
That's so much how it is, right?
It's as helpful and available as an intern but it's as knowledgeable as somebody with a PhD in everything and then like you said another analogy for that is like it's a store you have shelf space which is kind of limited but they do have a back and you can always send the employee to the back and see if they can find it in the back for you that's kind of like what you're saying put it in the database they can go fetch the specific thing that you're asking for because you know you gave it access to the back you gave it a badge that lets it go in there.
Have you uploaded all of like have you First of all, I want to know what your ChatGPT looks like.
I want to know how you use it.
I just want you to just screen share.
Just show me exactly what you do.
But also, have you uploaded your entire life?
Have you uploaded all of HubSpot to ChatGPT where you could just ask it any question?
Yeah, multiple times, right?
In what format? Tell me how you did that.
So OpenAI has called this...
It's called an embeddings algorithm that takes any piece of text, a document, an email, whatever it happens to be, and creates this kind of point in the high dimensional space called a vector embedding and you know a point in high dimensional space so in three dimensional space physical space that we know of we think of points being in three dimensions x y and z axis like oh here's where this point is in space high dimensional space you can have a hundred dimensions you can have a thousand dimensions you can describe each document as this kind of point in space so what I've done so it used to
be in the early kind of GPT world the number of dimensions you had access to was roughly like 100 to 200 dimensions dimensions.
And so you would lose a lot of the meaning of a document, right?
They would sort of get it right, it was sort of capture the meaning.
And then, then we went to like 1000 dimensions, it's like, Oh, well, now we can much more accurately sort of represent and capture a document of kind of arbitrary length and be able to find it, give it a prompt or given some sort of search query.
And then recently, within the last year, we've gone the latest algorithm algorithm from OpenAI, embeddings algorithm, is like 3 ,072, I think, dimensions.
But where do you do this?
Do you just literally upload it as a project?
Or you had to do an API connection?
How do you actually do this?
I'm doing an API connection, right.
In fact, I'm running the least, let me see where it is now.
And anyone can do this, or you have special access because you're friends?
No, anyone can do this.
The API for the embeddings model, they have two versions.
They have the 3 ,000 dimension version.
They have a 1 ,000 dimension version.
and it's the results of this like are you driving a nascar and i'm driving like a scooter like is that the difference like if i just like for example uh what i will do is i'll just like download my company's financials and i'll upload it and then i'll like explain what my company does but the way that you do it is a lot different now are we talking a massive gap in results that you get versus what i get um yes the short answer is yes uh and the reason is like so i do i do that that as well in terms of I'll describe the company or whatever I try to provide it context and that's why it's called
the context windows you try to provide the LLM context for what you're asking it to do you know the difference is that you know because I can go through like and by the way the richest and I'm working on a kind of nice and weekends project right now that takes email which you know so you would be amazed like if you had to write no other words right now if you did nothing but say i'm going to take all of my emails i've ever written uh that are still stored and give it uh to a vector store use an embeddings algorithm and then use chad gpt to let me kind of answer questions so if i want to say oh
i want you to give me a timeline for when we start first started using hub to name products or whatever and how that come about or what were the winning arguments against doing that versus whatever like it's shocking how good the responses are when you you give it access to that kind of rich data, right?
Somebody needs to create just like a $10 a month, a single website that's like, hey, make your chat GPT smarter.
And it's a website where it's like, connect your Gmail, connect your Slack, connect your everything.
I would pay them happily 20 bucks a month to just set this up for me to give my chat GPT like the extra pill that says, you now have access to my data.
Because you're talking about like, I have the API to the vector embeddings and like, well, I have the Flux Capacitor too, too, but I don't know what to do with it, right?
I need a button on a website with a Stripe payment button that I could just connect the stuff.
Is there a caveman version of this?
There are tools out there, and there are startups working on it.
There's two pieces of good news.
One is there are startups working on it.
The challenge here is not that they're doing a bad job.
The challenge actually comes down to if you're a startup and a startup came to you, it's like, Like, oh, we just started last week, but we've got this thing, it really works.
In fact, Darmex may be an investor.
How willing would you be to hand over literally your entire life and everything that's in your email over to this startup?
So part of the challenge we have is that the access control that, let's say you're using Gmail, which a lot of us use, when you provide the keys to your Gmail account to a third party, there is no degree of real granularity.
You can say, oh, I want it to read the metadata, that's like level one.
Level two access, I wanted to read my full email.
And level three is I wanted to be able to write and delete emails on my behalf.
But if you wanted to like read like the actual body of the email, you can't say I only wanted to read messages that are from HubSpot .com or I want to ignore all messages from my wife and my family or whatever in the thing.
There's no way to control that, right?
So you sort of have to have trust. Is there any product that you would trust right now or that you can recommend that guys like Sean and I should use as chat GPT add -ons or accelerators?
no not i not that i don't trust them but it's like i wouldn't trust really anyone right now with that and it's one of the reasons i sort of run it locally even though i know these things are out there um i predict what's going to happen is we're going to have uh any of the major players and you can see this happening already right we see this with um now you have the ability to create custom gpts and open ai and do projects and cloud you have google gems which are essentially like a small baby version of this right that says oh you can upload 10 documents 100 documents that And it'll let you ask
questions against what it's really doing behind the scenes is creating a vector store.
That's effectively what's happening.
My expectation is all the major companies will actually have a variation of this.
Starting with Google should be the first one because they already have the data.
There is absolutely zero reason why Google Gemini does not let you have a Q &A with your own email account.
That's just like insanely stupid, right?
Like I'll just go ahead and say it.
is just there's something not right with the world when they already have the data and it's like and they have the algorithm.
They have Gemini 2 .5 Pro, which is an exceptionally good model, right?
So they have all the pieces, but have not yet delivered, but I hope is will just tell me and Sean were early adopters, but neither of us are technical.
What can we do to I want to get it on this baby.
All right. So give me give me two weeks.
Here's here's so that's one thing I do trust and I trust myself.
I'm an honest guy. I'll give you like this internal app that i'm building let you point your gmail to it it'll go and it'll run for a day or two days or something like that and then you will be amazed you will be able to ask questions um and by the way like and the thing i'm like working on now is once you have this this capability right like step one is just being able to do q a right it's like oh just i'm gonna step to like imagine kind of fast forwarding like it has access to all of your kind of history so imagine you're able to say you know what i'm not doing this by the way but if i were it's
like i I want to write a book about HubSpot and all the lessons learned and like everything.
It's all in my email.
Do the best possible job you can writing a book.
If you have questions along the way, ask me.
But other than that, write the book.
I think you'll be able to write the book.
Wow. What else are you doing with AI?
So give me your day -to -day.
For example, the CEO of Microsoft had this great thing where he goes, I think with AI, then I work with my coworkers.
And that really shifted the way I work because I used to brainstorm or have a meeting to talk about stuff with my coworkers, which was honestly always like a little disappointing.
I felt like I'm the one bringing the energy and the ideas and the questions, and I'm hoping that they're gonna, but dude, just sparring with AI first and then taking the kind of like distilled thoughts to my team of like, here's how we're gonna execute has been way better.
Like that little one sentence he said shifted the way I was doing it.
How are you kind of using this stuff?
Yeah, so a couple of things.
So let's start at the high level and we'll drill in a little bit.
So what we're used to with chat GPT, this is sort of your kind of early evolution of most people's use is because it's called generative ai you use it to generate things right generate a blog post generate an image generate a video generate audio all those things that's kind of the generation kind of aspect and that's part of what it's good at then you sort of get into the oh but it can also kind of summarize and synthesize things for me it's like oh take this large body of text take this blog post it's academic paper and summarize it in this way or like so a seven -year -old would understand kind
of thing right so that's the kind of step number um step number two step number three and we're going to get into how this is now possible um is you can do um effectively you can take action um have the lm actually do things for you uh and i've always kind of put it broadly in the kind of automation bucket like i can automate things that i was doing manually before uh and then the fourth thing is around orchestration it's like can i just have it manage a set of of AI agents, and we'll talk about agents a little bit, and just do it all for me.
I just want to give it a super high order goal.
It has access to an army of agents that are good at varying different things.
I don't want to know about any of that.
I just wanted to go do this thing for me, right?
And then that's sort of where we are on the slope of the curve.
The first three things are possible today and work well today, right?
So you can generate, as we know, it can generate blog posts.
It can write really well.
It can generate great images now, including images with text.
It can do great video now with, you know, higher fidelity, higher character cohesion, and all these things.
Sean, so the thing, the vision you had three years ago when I was on was around creating the next Disney, the next kind of media company.
You have the tools now, my friend, to finally start to approach that, right?
But then you should sort of move into, and this is what we were just talking about, this kind of synthesis and analysis thing.
This is where deep research kinds of features come in.
It's like, okay, well, I want you to take the entirety of the internet or entirety of what Sean has written about copywriting and I want you to write a book just for me that summarizes all of that in ways I enjoy because I like analogies and I like jokes and I like this and I like that, write a custom version of Sean Puri's book on copywriting, right?
That kind of synthesis I think would be super interesting.
And then automation is now possible.
So agent .ai is one of those things.
There's other tools out there that says, hey, I want to take this work though or this thing that I do and I want you to just do it for me.
Give us a specific, what's a specific automation that you view as that's like, you know, useful, helpful, saves you time?
I'll tell you a couple.
One is around domain names, which is, okay, so I have an idea for a domain name And I'm going to type words in.
And these things exist. And I'll tell you the manual flow that I used to go to.
It's like, okay, first of all, I can brainstorm myself and come up with possible words and various other words, whatever, here's the things.
Then I'll say, okay, which domains are available?
Absolutely zero of them that are good that will pop into my mind are like freely available to kind of just register that no one's registered before.
Okay, fine. Then I'll say, okay, well, which ones are available for sale?
Okay, what's the price tag?
Is that a fair approximation of the value?
Is it like below market, above market?
we don't know because there's no Zillow for domain names yet, so create that.
So I have something that automates all of that and says, oh, so you have this particular idea for this concept, for this business, whatever it is.
Here are names. Here are the actual price points.
Here are the ones that I think are below market value, above market value.
Tell me which ones you want to register.
That's in ChatGPT? No, it's in agent .ai is where it lives right now.
But now there's a connector between agent .ai and ChatGPT through this thing called MCP, which you'll hear about a bunch if you haven't already.
One thing I want to kind of get out there, just so we keep connecting the dots, because I want everyone to have this framework in their head.
So we talked about large language models.
They can generate things.
We talked about the context window.
We talked about faking out the context window by saying, oh, we can do this vector database and bring in the right five documents, stuff them into the context window.
Here's the other big breakthrough that's happened, I'll say recently, within the last year, year and a half, is what's called tool calling.
And what tool calling is is a really brilliant idea.
And the tool calling says, okay, well, the LLM was trained a certain number of things, but if we had this intern that came in, it would be like saying, okay, well, whatever you know, you know, but we're not going to give you access to the internet.
Like that would be stupid.
Right? We would give the intern access to the internet.
It's like, if I ask you something that you weren't trained on, go look it up.
Right? That, that would be like, like thing number one on the first day of work.
And as it turns out, the LLM world, the intern couldn't, didn't have access to the internet.
All it had was whatever notes that happened to take during its PhD training and all things, right?
And so what tool calling allows, and this is a weird approach to it, but this is because of the way LM's work.
So remember, the LM it's architected such that you give it the context window in, it spits things out.
That's it. It doesn't have, and you can't reprogram the architecture.
Now all of a sudden we're going to give you access to tool calling.
So here's the hack that they came up with.
They said, okay, in the instructions that we give it in the context window we're going to say you have access to these four tools.
and it doesn't actually have access to the four tools is that I want you to pretend like you have access to these four tools the first tool is this thing called the internet and the way the internet works as you type in the query and it will give you some things back you have this other thing called a calculator and you can give it a mathematical expression and it gives you an answer back and you have this other tool that lets you do this and you can have n number of tools and so here's what happens in the context window happening behind the scenes chat TPT which which is the interface right now
that is interacting with the LLM.
You're not talking with the LLM directly, right?
It gets a prompt and it says, okay, by the way, LLM, I want you to pretend like you have access to these four tools.
And anytime you need them, when you pass the note back to me, the results, the output, just tell me when you want to use one of those tools.
All right, so we give it a query.
It's like, okay, well, I want to look up like the historical stock valuation for HubSpot and when it changed as a result of is there any correlation to the weather?
Is it seasonal or whatever it is, right?
in terms of market cap of HubSpot versus seasonal changes.
All right, well, that's not something you would have access to, but here's what actually happens.
This is so cool, right?
So the LM gets it, and the LM's in the context window that we gave it, we gave it instructions.
It's to pretend like you have these four tools, one of which is stock price lookup, let's say, historical stock price lookup.
It'll pass the output back to the application, not us, and say, and in the output it says, oh, please invoke that tool you told me I had access to and look up this result.
i want you to search the internet for x what was the weather i want you to do this for the stock price and then we do that we the chat gpt application fill the context window with whatever it is the lm asked for and then pass it back in so the lm effectively has access to those tools even though it never accessed the internet it never accessed the stock market but it pretended like it had access to it and we never see this this is happening behind the scenes now here is is the big massive unlock right which is well everything can be a tool right now you don't have to build this kind of vector store
or whatever because you would never build a vector store of all possible stock prices from the dawn of time now i guess you could but then it's outdated immediately now it's like what if we just gave it 20 really powerful tools including browser access to the internet well that's like a 10 000 100 000 times increase in that intern's capability right and so that's where our brains should be headed now it was exactly where the world is headed that says, what tools can we give the LM access to that will amplify its ability and cause zero change to the actual architecture?
Literally, it doesn't have to know anything about anything.
It's like, I just want you to pretend that you have access to these tools.
It doesn't need to know how to talk to those tools.
It doesn't need to know about API.
It doesn't need any of that stuff.
Cutting your sales cycle in half sounds pretty impossible, but that's exactly what Sandler Training did with HubSpot.
They used Breeze, HubSpot's AI tools to tailor every customer interaction without losing their personal touch. And the results were incredible.
Click -through rates jumped 25%.
Qualified leads quadrupled.
And people spent three times longer on their landing pages.
Go to HubSpot .com to see how Breeze can help your business grow.
Do you think that, I mean, this is all mind -blowing, and you have an interesting perspective because, you know, I think three episodes ago that you were on, You created this thing called Wordle.
Was it Wordle? Wordplay.
Wordplay. That does like 80 grand a month.
It was just like a puzzle that you did with your son.
It was amazing. But now you have new projects.
You have Agent AI. You have a few other things.
But you still run a $30 billion company.
Do you think that the majority of value creation...
Is my stock portfolio going to go up because I own a basket of tech stocks?
contracts or is the best way to capitalize as an outsider?
Obviously, you start a company or is it investing in new startups that are using AI or AI -first startups?
It's a, yeah, it's a good question.
I'm neither an economist nor a stock analyst, but I will say this.
The thing I'm most excited about with AI, and I actually said exactly this in a talk I gave well before GPT on the inbound stage.
And I said, as AI is starting to kind of come up, it's not a you versus AI.
That's not the mental model you should have in here.
It's like, oh, well, AI is going to take my job because it's me trying to do things that the AI is then eventually going to be able to do.
The right mental frame of reference you should have, it's you to the power of AI.
AI is an amplifier of your capability.
It will unlock things and let you do things that you were never able to do before, as a result of which it's going to increase your value, not decrease it, right?
But in order for that to be true, through, you actually have to use it.
You have to learn it.
You have to experiment with it.
And the only real way to get a feel for what it can and can't do is you have to do it.
So I'll give you the very, very simple, everyone should do this, I do this personally, is that anytime you're going to sit down at a computer and do something, research, whatever it is you're going to do, you should give ChatGPT or your AI tool of choice a shot at it.
Try to describe, I pretend like you have access to this intern that has a PhD in everything?
It's like, okay, well, maybe it doesn't know anything about me or whatever.
Fine. So then tell it a few things about you.
But imagine you have access to this all -knowing intern that has a PhD in everything.
Give it a crack at solving the problem that you're about to sit down and spend some time on.
And what you will invariably find, number one, is you'll be surprised by the number of times it actually comes up with a helpful response that you would never have expected it would be even remotely able to do.
Like, how can it do that?
It's because it has a PhD in everything, thing right is now actually we'll talk about reasoning and whether models are actually doing that or not if we have time but um so that's my advice is every day every day um you should be in chat gpt if you're a knowledge worker at all it doesn't actually you don't even have to be a knowledge worker and i don't care what your job is right you could be a sommelier at a restaurant and you should be using chat gpt every day um for to make yourself better um at whatever it is you do and that might be the introduction of that orthogonal skill to bring it back
to the which I never explained the word orthogonal.
So I'll do in 30 seconds.
So orthogonal means that line that's 90 -degree intersection to another line.
And the most common use is when we have an X and Y axis, right?
It's like, oh, the X axis and the Y axis are orthogonal to each other because they have 90 degrees separating them.
The common usage, when you say, oh, that's an orthogonal concept, it means it's unrelated.
It's completely different.
The Y and X axis are completely independent of each other.
You can say, oh, you can be here on the X axis, but here on the Y axis, and they're not related to each other.
So that's what I mean when I say orthogonal concepts, or skills, or ideas.
Yeah, anyway. Is there anything you disagree with that's kind of the consensus?
Because a lot of things you're talking about, like, hey, AI is going to change everything.
It's super smart. Agents are coming.
They can do some stuff now, more stuff later.
These are all probably right, but they're also consensus.
I'm just curious, like, is there anything you disagree with that you hear out there that drives you nuts, where you're just like, people keep saying this.
I think that's either wrong, it's overrated, it's the wrong timeline, it's the wrong frame, it's, uh, whatever?
Is there anything that you disagree with that you've heard out there?
I've heard variations, two variations I disagree with.
One that I've, I think, spent so much time, hopefully, kind of talking folks out of, which is, it's just autocorrect.
It's not really thinking.
And that's a matter of like, what do you think thinking is, right?
It's like, okay, well, if it produces the right output to which we think would require thought, so I think that is flawed reason to say, And this often comes from the smartest people, the most experts in their field, because, oh, it's really like a stochastic parrot.
You'll hear this phrase, which is it's like a probability driven pattern matching based.
It just so happens that's been trained on the Internet, but it's not really like human intelligence.
And I agree with that phrasing, which is it's not like human intelligence, but that does not mean that all is doing is sort of mimicking stochastically all the things I've read before, because in order to do what it does, it is a form of creativity different from what we normally express.
that's kind of thing number one that i disagree with thing number two is people are thinking i both disagree with the oh the scaling laws are going to continue forever indefinitely that the more and more compute we throw at the more knobs we put on the machine the smarter smarter it's going to get i think there's going to be a limit to that at some point it's like nothing goes on forever it's going to asymptotically move towards we're gonna have to come up with new algorithms so that's gpt can't be the dual end of all things right there will be a new way discover.
So I think that's going to happen.
But I think the smarter, and I did say this, other people have said it, the best way to think about AI right now is, as you use it, is to truly find a frontier of what it's incapable of.
It's like, okay, it can sort of do this thing, but not very well.
If that's the way you describe its response, you are exactly where you need to be.
Which is, if it can sort of do it right now, sort of.
have, if you have to squint a little bit, it's like, it's kind of something, but wait six months or a year, right?
Like it's that's the beauty of an exponential curve.
It gets so better, so much better so fast that if it can sort of do it now, it will be able to do it and then it'll be able to do it really well.
That's the inevitable sequence of events.
That's kind of you heard this about startups.
There's like a kind of the smart money and startups believes that the right startup to build is basically the thing that AI kind of can't do right now.
That's the company to start today because you just have to stay alive long enough.
Give it the 12 to 18 month runway that it needs for the thing to go from, eh, didn't really work very well to like, oh my God, this is amazing.
But you've built your brand, your company, your mission, your customer base.
You've been building that all along the way.
And you're basically just betting you're going to be able to surf the improvement of the model.
Dude, by the way, that's how I feel about my company.
My company is not related to us at all.
But in terms of our operations, where, like, things are very manual, and I'm like, oh, my God, once I'm able to finally implement AI when it can work for this purpose, my profit margin is going to go through the roof.
I mean, that's how I feel about it, which isn't entirely related to that, Sean, but a little bit.
One thing I'll plant out there, since this is my first Million Week, we like talking about ideas.
At a macro level, here's the entirely new pool of ideas that I think are now available on a trend that I think is inevitable, which is ad agents get better and better right now most of us when we use uh use AI use chat tpt uh we use them as tools which is great perfect uh fine uh over time you just shift your thinking and think of them as teammates think of them as that intern that just got hired right uh and and as a result of that so let's let's assume for a second let's stipulate that I I'm right all we don't know is how long is it going to take for me to be right is that we're going to have effectively
digital teammates that are part of all of our teams. Every company is going to someday have a hybrid team consisting of carbon -based life forms and these kind of digital AI agents.
Okay. So if you accept that, the way that's going to happen is not going to be like all of a sudden we one day wake up and every organization now starts kind of mixing them.
What's going to happen is it's going to slowly introduce this way.
It's like, oh, I have this one task, whatever that an agent is better at, it's reliable enough for the thing and the risk is low enough.
I'm going to have to do that.
We already see elements of that, but here's what's going to happen as a result of that kind of gradual kind of infusion and adoption of that technology.
The way to win and the opportunities that get created is like, how do I help the world accomplish this end state that I know is going to come?
So here I'll give you some examples.
If we were to hire, if you, Sam, were to hire a new employee tomorrow, here's what you would do.
You would say, oh, well, I'm going to onboard that employee, spend a couple of days.
I'm going to tell them about the business.
Whoever's managing that employee, let's say it was a direct report of yours.
Maybe you'll have a weekly one -on -one or every other week or whatever.
That one -on -one will consist of looking at the work they did, whatever it's like, oh, over here you did this or whatever, and it could be copy editing.
It could be anything, whatever the role happens to be.
You're going to give them feedback, right?
That's what you would do for a human worker.
All of those things have a direct, literally a direct analog in the agent world, right?
And what we're doing right now is we're hiring these agents and expecting them to do magic just like if we hired an exceptionally smart, has a PhD in everything employee and expected them to do magic with no training, no onboarding, no feedback, no one -on -one, no nothing.
Well, your results are not going to vary.
They're going to be crap because you do not make the investment in getting that agent.
Now, the big unlock here, so whether you're an HR person or whatever, it's like figure out, well, what does employee training look like for digital workers?
What do performance reviews look like for digital workers?
How do we do recruiting for digital workers?
workers. How do we, like, what are all the mechanisms that need to exist?
What is a manager of the future?
What are the new roles that will be created as a result of having these hybrid teams?
It's like, okay, well, now maybe we're going to need someone that's like the agentic manager, human, that knows all the agents that are on their team or whatever and has kind of built the skill set to how to do recruiting for their team, how to do performance reviews, how to do all of that, but for agents or hybrid teams, you know, versus just purely human ones.
That's just a whole other, and we're going to need the software, we're going to need the onboarding, we're going to need training we're gonna need books written we're gonna need all of it to kind of adopt and it's gonna take uh it's gonna take years right it's not uh happening overnight two years ago i asked you is it gonna be as bad or i think you said i asked is it gonna be horrible or is this gonna be amazing and you said uh this i saw this with the internet nothing is as extreme as the most extreme predictions i listened to you and i trusted you then i actually think knowing what i know now
I'm actually more fearful than I was a couple years ago where I'm like, oh, this is actually going to put a lot of people out of work.
And it's maybe not good or bad, but things are going to change drastically more than I thought.
So I don't remember how I phrased the question, but is this going to change the future more than you thought two years ago or less than you thought two years ago?
Has your opinion on that changed?
I still think they're going to be unrecognizable.
my my kind of macro level sense and this is maybe just my inherent uh optimism about things is that it's going to be kind of a net positive for humanity and this is the other thing that um you know lots of people would disagree with me on this like oh well is this an existential crisis you know to the species um and i've not said this before but i'm gonna see how it sounds uh as the words leave my mouth i'm probably gonna regret it but in a way we are actually and sammy um Shani, you said this earlier, we're sort of producing a new species, right?
So that's like saying, okay, well, homeo sapiens as they exist to absent AI is likely not going to exist. So the way we know the species as it exists today with where we have a single brain and in natural form, you know, for appendages or whatever, maybe that's going to be different.
But I think of that as an extension of humanity, not the obliteration of humanity, right?
That's the that's, you know, human 2 .0 or n .0 of the way we kind of think of the species right now.
So I'm, I think things are are still moving very, very fast. And this is the, this is why I think humans have issues with exponential curves.
We're just not used to them when something is kind of doubling or, you know, every and months, it's hard to wrap our brains around how fast this stuff, you know, can move things that we thought were like the things we have today, Sam.
If we had just described them to someone a year and a half ago, there's like, ah, well, chat CBD is cool or whatever, but it's never going to be able to do that and now we're like those are like par for the course right like we can do like things that were literally like oh there's no way no way it's like yeah it's good like text and stuff like that but that's because it's been trained on text now i can do images well i can do images but like video is like 30 frames a second that's like third and generating 30 images per frame of like a per second of videos like all of that it's like yeah but you
know diffusion models the way they work is because you're not going to get you get a different image every time So how are you going to create a video because it requires the same character of the same setting in subsequent frames?
That's not how the thing is arched.
That's not how image models work and we solved all of those things right now we have character cohesion setting cohesion the video generation anyway, so my answer is It's exactly not exactly but it's close to like yep, this is what exponential advancement looks like I'm still the belief that we're gonna have more net positive.
That is not to say that in the interim there's not going to be pain um and there's two things i'll put out there as cautionary uh cautionary words one is in the interim um anyone that tells you that there's not going to be job dislocation there's not going to be roles that get completely obliterated is lying to you that is going to happen it's already happening right it's um that there is no world in which that does not uh occur that's kind of thing number one thing number two and we didn't talk about this but we should have um is that because of the architecture of how lms currently work maybe
they'll figure figure out a way to do that.
They produce hallucinations.
And that's just a fancy way of saying it makes things up.
Right. And that's sort of okay, but not okay, because it doesn't know it's making it up.
Because of the way the architecture works, it's like the intern that thinks it's been exposed to all there is to know in the world.
It's like, I know all the things.
You're asking me a question.
I know I know all the things.
So I'm going to tell you the thing that I know.
It's like, well, yeah, but you didn't know this.
And what you said is actually perfectly factually like provably demonstrably wrong and has as aptly zero lack of confidence in its output um which is fine for some things if you're writing a short you know fiction story or something like that it's not great at all for other things like healthcare related where you need uh kind of predictable accurate responses so i think we need to be aware of the limitations around it when we're doing research and things like that uh and the problem is when we have have relatively, I'll say naive, I don't mean this in a disparaging way, folks that are naive to
a subject area asking ChatGPT for things where it can't judge the response, right?
We're sort of taking it on faith that it's ChatGPT and our mesh set has got a PhD and everything.
So of course it's going to be right.
Well, no, it's often not right.
And it's kind of up to us to figure out what our kind of risk tolerance is.
It's like, when is it okay for it to be wrong?
How would I test it for my domain, for my particular use cases?
Yeah, so. So you guys know this, but I have a company called Hampton.
Joinhampton .com. It's a vetted community for founders and CEOs.
Well, we have this member named Levon and Levon saw a bunch of members talking about the same problem within Hampton, which is that they spent hours manually moving data into a PDF.
It's tedious, it's annoying, and it's a waste of time.
And so Levon, like any great entrepreneur, he built a solution and that solution is called Molku.
Molku uses AI to automatically transfer data from any document into a PDF.
And so if you need to turn a supplier invoice into a customer quote or move info from an application into a contract, you just put a file into Moku and it auto fills the output PDF in seconds.
And a little backstory for all the tech nerds out there, Slavon built the entire web app without using a line of code.
He used something called Bubble .io.
They've added AI tools that can generate an entire app from one prompt.
It's pretty amazing.
And it means you can build tools like Moku very fast without knowing how to code.
And so if you're tired of copying and pasting between documents or paying people to do that for you check out mulku .ai m -o -l -k -u .ai all right back to the pod what do you think about this situation where zuck is throwing the bag at every researcher 100 million dollar signing bonuses even more than that in in comp and he's poaching basically his own dream team he's like okay you're not gonna i can't acquire the company well why don't i go get at all the players.
If you can keep the team, I'll keep the players.
And he's going after them with these crazy nine figure offers.
100 million signing bonus and 300 million over four years, I think is what I saw.
Is that true? I think that was like the higher, yeah, so the higher end.
And some people have said there's even like billion dollar offers to certain people that are out there.
This is like job offers.
So Dharmesh is like, were you shocked by this?
Because I mean, my reaction to this was, that's bullshit.
First time I heard it, then I was like, wait, the source is Sam Altman.
Why would he say that?
And then I was like, okay, that's insane.
And then an hour later, I was like, wait, that's actually genius.
Because for a total of $3 billion or something, he can acquire the equivalent of one of these labs that's valued at $30, $40, $50, or $200 billion.
What a power play. I know, obviously, you're an investor in OpenAI, so maybe you don't like this.
Maybe you have a different bias here.
But from one kind of leader of a tech company to another, what's your view of this move?
I think it's one of the crazier moves.
If I had to use one word, I would say diabolical.
Not stupid, not silly, but diabolical.
And here's why, right?
This is the, like, in the grand scheme of things.
So, this is not just a, oh, can we use this technology and build a better product that will then drive X billion dollars of revenue through whatever business model we happen to have. There's a meta thing at play here that says whoever gets to this first will be able to produce companies with billions of dollars of revenue or whatever, right?
Because that's kind of finding the secret to the universe, the mystery of life kind of thing.
It's like, okay, well, whoever wins that and gets there first will then be able to use the technology internally for a little while and be able to just kind of run the table for as long as they want.
So it's got incalculable value.
The upside is just so high that no amount of, like, if you can increase your probability even by a marginal amount, if you had the cash, why wouldn't you do it, right?
So do you think, A, do you think it'll work?
Do you think this tactic will work for him?
Do you think he will be able to build a super team?
Is he just going to get a bunch of engineers who now have yachts and don't work?
Like, what's going to happen when you give somebody $100 million offers, you put together this, smash together this team of, I think he's got a hit list of 50 targets.
And I think like, you know, something like 19 or 20 of them have come on board already.
What's your prediction of how this plays out?
It feels a little bit like a Hail Mary pass, right?
That's okay. They're going to take this.
It's like, okay, well, there's not a whole lot of things we can do.
You know, the chips are down.
out. I'm going to mix metaphors now, too.
But that works sometimes.
It works sometimes.
That's exactly why people do it.
It's like, okay, what other option do we have?
Everything else hasn't worked yet, so let's try this thing.
But I think the challenge, I still think it's a diabolically smart move.
I'm not going to use the word ethics or anything like that.
But here's the challenge though, right?
If we were having this conversation, we'll call it two years ago, give or take.
OpenAI was so far ahead in terms of the underlying algorithm and this even before ChatGPT hit the kind of revenue curve that it's hit, just raw the GPT algorithm was just so good and they were so far ahead it was actually inconceivable for folks including me that others would catch up it's like, okay, well, they'll make progress they'll get closer, but then OpenAI is obviously going to still keep working and they're going to be far ahead for a long, long time that's proven not to be true, right?
We've seen open source models come out, we've seen other commercial models come out there's entropic.
And they have, by most measures, comparable large language models, right?
Within like one standard deviation, they're pretty good.
And sometimes they're better at some things worse than others.
But it's not this single horse race anymore.
So the thing that I'm a little bit dubious of is that even if you did this, you pull all these people together, like it didn't really work for open AI in the true sense of the word, right?
Like they weren't able to create this kind of magical thing that it's like, okay, maybe they they end up doing it somewhere else, but I think there's more smart people out there.
The technology has kind of deep -seeked, proved that you could actually, and they did actually have an actual innovation in terms of reasoning models and things like that, versus kind of the early generation large language models.
So, jury's still out.
How much better is a $300 million over, so $100 million a year engineer over like a $20 million engineer?
Is it like, I followed some of these guys on Twitter, And it was their fantastic follows.
And do you think that their IQ is just so much better?
Or is it because they've had experience?
Is it really because they just saw how open AI works, and they want that experience?
Are they like, is this like espionage?
What is how good could 100 million or $300 million a year engineer be?
Well, that's the thing.
So this is software, right?
So this is a, you know, a world of like, 95 % margins.
So let's say, yeah, I think part of the value is yes, they're super smart.
But But even human IQ asymptotically moves towards a certain ceiling, right?
You take smartest people in the world, however you want to measure IQ.
And so that doesn't explain away the value, right?
That's not that. It's not that they've seen the inside of open AI, and they have some trade secrets in their head that they can then kind of carry over.
It's like, oh, here's how we did it over there.
And here's how we ran evals.
And here's how we did, you know, the engineering process.
They'll have some of that because we always carry some amount of kind of experience in our heads.
I think the larger thing, I think the primary kind of vector of value is they sort of have demonstrated the ability to kind of see around corners and see into the future.
Right. They believed in this thing that almost no one believed in at the time.
They sort of saw where it was headed and they were working at it, chipping away at it, whatever.
And that's much rarer than you would think for really smart people to do this stupidly foolish, seemingly stupid, foolish thing.
It's like, you're going to do what now?
Right. Right. And we're still asking ourselves a variation of that question that we would have asked three years ago, except now we have chat GPT and we have the things in it and we're still like, well, you say that we're going to have like these kind of digital teammates and they're going to be able to do all these things.
And it can't even do this simple thing right.
Right. Like we sort of keep elevating our expectations and what we believe is or is not possible.
They sort of know what's possible and they almost think of what many of us would consider impossible is actually being inevitable.
Have you guys, has HubSpot, have you made any of these offers?
I don't think so. But that's not the game we're in, right?
So we're not in that league.
We're not trying to build a frontier model.
We're not trying to invent AGI.
We're at the application layer of the stack.
So we want to benefit from it, right?
You know, we didn't, in any layer of my entrepreneurial career, I have not been the guy in the center of the universe or the company in the center of the universe.
But you're not like, oh man, I met this person, like we need to offer like an MBA contract in order to secure this guy.
No, and there's a reason for this, right?
It's like for the kinds of problems we're solving, what's the, there's a sports term about the best alternative to the player or something like that, the replacement More.
Wins above replacement is the metric they use in sports So, yeah, it's just not worth it given our business model and given what we do I have one last thing on the kind of AI front, this is one of the things answering your question, Sean, in terms of things I disagree with folks on is that there's a group of people very smart that will say, oh, well AI is going to lead to a reduction in creativity, broadly speaking right because you're just gonna have ai do the thing why do you need to learn to do the thing and i have a 14 year old right so it's like okay well if he just uses ai to write his essays
and do his homework or whatever um it's gonna kind of reduce his creativity and i understand that particular kind of line of reasoning that says yeah if you just have it do the thing um you're not going to uh but i think the the part those folks are missing is that uh you know creativity is kind of in the literal sense the word is like okay i have this kind of thing idea in my head and I'm going to express it in some creative form, be it music, be it art, be it whatever it happens to be.
And the problem right now is that whatever creative ideas we have in our head are limited in terms of how we can manifest them based on our emerging skill set.
So Sean can have a song in his head right now that he may be composing things in his head, but until he learns the mechanics of how to actually play an instrument, whatever the instrument happens to be, there's no real way to manifest that, right?
We can't tap into his brain and do that.
So in my mind, AI actually increases creativity because it will increase the percentage of ideas that people have in their heads that they will then be able to manifest regardless of what their skills are or not.
And I love that. So my son, he's a big Japanese culture fan, big manga fan, Japanese comic books and anime.
And so he's an aspiring author someday.
And what he can do now, and he's been able to do this for years, which is, so he's always had again he likes fantasy fiction as well so he's had these ideas for writing things but he lacked the writing skills, he doesn't know about character development he doesn't know about any of these things so what he uses chat GPT for is he's got this like 2000 word prompt that describes his fictional world here are the characters, here's a power structure here are the powers people have, here's what you can and can't do and then the way he tests the world is he turns it into a role playing game it's like
okay, I'm going to jump into the world, now you chat GPT, I'm going to do this, tell me what happens, oh this happened happened okay now I'm gonna do this okay well now you've got this power like and so it will sort of kind of pressure test kind of his world and so that's an expression of his creativity because the world was sitting in his head but now he can actually share that with friends maybe turn that into a book someday because it's gonna take the ideas that he has and hopefully in the meantime he will kind of develop some of those foundational skills but he doesn't have to wait until like
12 years of writing education before he can take this idea as a child he has lots of creativity uh but as a practitioner most of those things that he would would love to be able to manifest in the world he has nothing uh close to the skills required whether it's drawing or writing or anything so i think that's what ai can help us kind of elevate um what and once again but we have to use it responsibly uh but it should be able to elevate our skills i want to show you guys a uh example of this real quick so i had this idea not long ago a couple weeks ago of um creating a game using only ai so um
i don't know if you guys has ever played the monkey island games from like when i was a kid i played monkey island it was a incredible game it's got basically this guy wants to be a pirate it's like this very funny but like eight bit art style game and so i created a version of that called escape from silicon valley i didn't create the whole game but i create like the art but like check this out so so i go into i go into ai and i basically start creating the game art and so it's like the story is basically like deep in san francisco the year is 2048 the block is starting his third term in office
uh you know nancy pelosi passes away the richest woman on earth and then you know elon is promising that self -driving cars are coming really really soon for real this time and here you are you're this character and you're in um the open ai office and basically look at that what's that look at the charlie bar yeah yeah exactly i was putting in some references to like you know stuff that i thought was um it would be cool that is so cool what did you use to make those images so that right there was just chat gpt and the journey um mix i tried using you know scenario and a couple other like game specific
tools like check this out so like i created all these like tech like characters so it's like i create zuck and palmer lucky and like chamath and elizabeth awesome and i had it basically write the scenes for the levels with me like write the dialogue with me create the character art dude that looks sick why didn't you do that um well because i did the fun part in the first two weeks where I was like, oh, the concept, the levels, the character art, the music, seeing what AI could do, but then to actually make the game, the AI can't do that.
And so I was like, oh, now I need to like, I mean, people who build games in years building it, it's like, oh, this is like minimum six to 12 months doing this very, very arbitrary project, but I still love the idea, and I'm going to package up the whole idea.
Dhar Mesh, last question.
Just really quick, quick like you where do you hang out on the internet that we and the listener can hang out to stay on top of some of this stuff like are there like who's a reputable handful of people on twitter to follow or reputable websites or places to to hang out at that's interesting so i spend most of my time um on youtube as it turns out um and and i sort of give into the vibes, so to speak, and let the algorithm sort of figure out what things I might enjoy.
It gets it right sometimes, it gets it wrong sometimes, so it's a mix of things, but the person that I think if you want to get deeper into understanding AI, there's a guy named Andrei Karpathy.
I don't know if you've come across him.
Just search for Karpathy.
Dude, you don't want to know how I know.
I get so many ads that say Andrei Karpathy said this is the best product, or Andrei Karpathy you showed me how to do this.
Now I'm going to show you like, I don't even know who Andre is other than ads run his name to promote him.
Yeah. I mean, he's yeah.
One of the true OGs in AI, but he has that his orthogonal skill or one of them, I think he's got like nine, he's probably like a nine tool player of some sort, but he's able to really simplify complicated things without making you feel stupid.
Right. So he's not talking down to you.
He's like, okay, like, here's how we're going to do this.
We're going to kind of build it brick by brick.
And you're going to understand at the end of this hour and a half how X works, right?
And he's amazing, so that would be one.
So him, any other YouTubers or Twitter people or blogs?
On the business side, actually, Aaron Levy from Box is actually very, very thoughtful on the, if you're in software or in business and the AI implications there, I think he's really good.
Hiten Shah, who you both know now at Dropbox through the acquisition, has been on fire lately on LinkedIn, so he's one I would go back, especially for the last like three four months uh and read all the stuff he's written i think he's on point uh the episode those are awesome darmash thanks for coming on thanks for teaching us you're one of my favorite teachers uh and entertainers so thank you for uh for coming on man my pleasure it was good to see you guys it's fun likewise thank you that's it that's the pod i feel like i can rule the world i know i could be what i want to i put my all in it
like All right, my friends, I have a new podcast for you guys to check out.
It's called Content Is Profit, and it's hosted by Luis and Fonzie Cameo.
After years of building content teams and frameworks for companies like Red Bull and Orange Theory Fitness, Luis and Fonzie are on a mission to bridge the gap between content and revenue.
In each episode, you're going to hear from top entrepreneurs and creators, and you're going to hear them share their secrets and strategies to turn their content into profit.
So you can check out Content is Profit wherever you get your podcasts.
