ChatGPT has announced that they are going to start routing sensitive conversations to GPT-5, even if that wasn't the model you originally selected.
In addition to that, they're going to start rolling out parental controls.
There's a whole bunch of things that essentially OpenAI has announced in response to a lawsuit and a bunch of other issues and questions.
We're going to be diving into all of that Today, it's a very, I guess, tricky subject.
Someone recently that committed suicide a teen and they looked at his chat GPT logs and he'd been talking with chat GPT beforehand and had asked about suicide methods and other things.
So it's a bit of a sensitive topic.
There's a lot of controversy in this.
And so anyways, I'll try to tread lightly, but I have a different opinion on this than I think a lot of people.
So in any case, we're going to get into the podcast today.
Before we do, I wanted to mention that my own startup has just launched our AI app builder.
So it is finally live on our website AIboxai where essentially, if you have any sort of AI tool or workflow you'd like to generate, you can go in type in the prompt to describe what kind of tool you know a newsletter generator that takes in articles that you paste in and it generates images for your newsletter and maybe an audio file with 11 labs, and it will be able to stitch together a workflow and create the tool.
So I would love for you to try it out.
Let me know what your thoughts are.
It's AI box.ai.
I will leave a link in the description.
I am super excited.
I've been working on this for a couple years, so big news for me.
We're working on bugs, we're working on fixing stuff, we're working on adding new features, so if you have anything, any requests, feel free to send them over.
All right, let's get into the episode today.
So uh, essentially all of this comes back to a lawsuit that has been launched against open ai um from a the, the parents of a family who had their teenager tragically committed suicide, and they looked at his chat gpt logs and he had been using chat gpt.
In response to this, i think, opening eyes, trying to tread lightly.
They're trying not to, you know, assume responsibility for this, but also trying to help, maybe make tools in the future to prevent tragedies like this or at least help people identify when there's someone in mental distress.
This is kind of what basically all of the tools that they're rolling out are are around, so there's kind of these parental controls.
The new guard rails are all going to be coming in in the next couple months.
They posted a whole blog post about this where they essentially acknowledge some of the shortcomings in their ai safety systems.
They said you know they they don't always maintain guardrails during extended conversations.
While OpenAI is, you know, not saying that they're claiming responsibility for basically any of the tragedies that have happened recently, they are saying that they are going to make some changes to basically how this works.
Some people attribute these to quote unquote fundamental design elements.
One of the big things that it gets criticized frequently for is essentially that it validates a user.
And that's just kind of how these AI algorithms work in conversations.
And so if someone says something harmful or bad or you know, maybe they're going down some sort of mental breakdown, basically it's not going to catch that, it might just validate them.
And this is a case another case we also saw recently.
So there was a extreme case that the Wall Street Journal actually reported on of Stein Eric Solberg.
This is also kind of.
These are all kind of heavy topics and sad stories to cover.
But this is what's happening.
So there was a murder, suicide.
There was a man who had a psychotic episode.
He basically had a history of mental illness, he used chat gpt, he had this paranoia that he was being targeted in a big conspiracy and eventually it progressed so bad.
Um, you know, chat gpt kind of like played into it like, oh yes, maybe you're being, you know, targeted in this conspiracy and it never, you know.
It just kind of went along with him and then ultimately he ended up killing himself and his mother, which is terrible.
OpenAI says that one of the solutions they believe to this conversation and kind of helping their AI models to not go off the rails is essentially to automatically route sensitive chats to a reasoning model.
One of the tricky parts about this is if you're using a non-reasoning model 40, it's just a strict LLM.
That's just kind of.
It doesn't really think about the conversation itself, beyond just thinking about what the response is.
But if you send it to something like GPT-5, not only is it looking at what you're saying, but it's looking at why you're saying it.
It's looking at multiple outputs.
And you can put a whole bunch of filters around what it's saying and how it responds to you.
Something like this where it's, you know, going along with someone's mental breakdown of this grand conspiracy, an LLM is just designed to respond.
And so it's just going to follow him down that conversation.
Whereas GPT-5, you're actually able to put in some sort of guardrails directly into the model where it's like, if someone starts saying XYZ starts going in this direction, these are how you can detect that essentially, they're having some sort of mental breakdown, and you can catch it.
Now, I think the real question here is, you know, like who is responsible for this?
The argument I hear a lot and I tend to kind of agree with is that it isn't necessarily the AI model's responsibility.
If you went to Google, for example, and searched AI for how to do harm or how to basically do something bad, you will find an unlimited amount of websites or sites or comments on Reddit or anywhere else where you can find all sorts of information, basically.
And so I just don't think that the AI model because the AI model will, you know, say this is how you make a nuclear bomb and might spit it out.
And of course, they're trying to put guardrails on something like that.
But like, anything that the AI model says is also on the internet.
So I like, beyond censoring the internet, I don't really think, I don't think that censoring the AI model is necessarily the answer or that they're liable for that.
I mean, it's an absolute tragedy, but people with... Anyways, it's a tricky conversation.
There's definitely tragedies, but it's really hard to say how you can censor the AI model.
And the other issue that I see is essentially that if you start to censor the AI model too much, I definitely believe that there's a slippery slope of who picks what is censored.
And of course, I think there's very easy things like self-harm and other things like that.
But I do think that there's a lot more controversial things that people politically on the right or politically on the left would agree is truth or isn't truth and will argue about.
And so I just hope that this doesn't basically get politicized.
I want to bring up the comment made by the lawyer who is suing ChatGPT on behalf of the family, of course, of the teenager that committed suicide.
And I think this is kind of like it plays into basically me thinking that like, Obviously there's a tragedy there.
Obviously like I'm heartbroken for the family, but I don't think the way they're going about this is probably correct.
The lawyer has Jay Edelson.
He is the lead counsel for the Rain family's wrongful... death lawsuit against OpenAI.
And he basically said that ChatGPT's response has been quote unquote inadequate.
He said, OpenAI doesn't need an expert panel to determine that ChatGPT 4.0 is dangerous.
They knew that the day they launched the product and they know they know it today.
Nor should Sam Altman be hiding behind the company's PR team.
Sam should either unequivocally say that he believes ChatGPT is safe or immediately pull it from the market.
And I think, in a case like this, where he's literally saying, you know, because ChatGPT could play along with someone's mental breakdown, or because it could say how to do something dangerous, which you could find the same information on the Internet.
You know, the whole the whole product has to be completely pulled from the market.
I just think that it's way too extreme.
And if you wanted to look at all of the good that ChatGPT does, all the good things that it helps people with.
Of course, I think we should add more guardrails.
It's really tricky with any new technology.
We don't always know all of the negative repercussions.
And OpenAI, I'm sure, has spent millions of dollars on red teaming to try to make this thing safe.
But at some point, we have to put it out into the world to see how it's used.
When there's tragic cases like this, we try to reflect and make changes to make it more safer in the future.
And so this is what OpenAI has essentially responded by saying.
They said we recently introduced a real-time router that can choose between different efficient chat models and reasoning models based on the conversation context.
We'll soon begin to route some sensitive conversations, like when our systems detect signs of acute distress, to a reasoning model like GPT-5, So it can provide more helpful and beneficial responses, regardless of which model a person selected.
OpenAI says that it's, you know, GPT-5 thinking and its O3 models are built to basically spend more time thinking for longer.
And they're actually looking at the context before they answer, which they say will give quote more resistant to adversarial prompts.
And I think adversarial prompts is one way of saying like one person's adversarial prompt, like me trying to go in and trick chat to give me the recipe for a nuclear bomb, which like I might try that on a new model, just to see basically what is it's capable of.
But adversarial prompt also is like someone that is actually in mental distress will be saying something for real that I might just be trying to trick it to say, just to see what it's capable of.
So anyways, one person's adversarial prompt is another person's actual issue.
So they're actually, I don't know, I don't know.
I don't love the framing of like, we're building this to like stop adversarial prompts.
It's like, no, you're building it to stop unsafe prompts.
Anyways.
So OpenAI is also going to be rolling out parental controls in the next month, which basically parents are going to be able to link their account with their teen's account through an email invitation.
This is going to come in OpenAI talk kind of in late July about this new study mode in ChatGP that helps students maintain critical thinking capabilities while studying.
So basically it wasn't giving them the answers.
It was helping them come up, come to the answers.
So that was kind of, I think, a first step in this direction.
Now they're going to be doing these kind of parental controls.
You can tie it.
Parents are also going to be able to control how ChatGBD responds to their children with a quote age appropriate model behavior rules which are on by default.
All of this I do think is good, especially when it comes to children and parents being involved with kind of what their children see.
The one thing that I will say, though, is it's probably part of a broader conversation.
I think all of these tools are incredibly useful, incredibly valuable.
I'm all for parental controls and helping parents kids be able to access the internet and things in safe ways.
What I will say though is, when it comes to teenagers accessing things on the internet and we talk about ChatGPT, having parental controls and tying their accounts to their parents and stuff like that I think that if a teen is having some sort of issue, they could easily just not use their monitored ChatGPT account.
So I don't really think it solves that many problems.
It's not an end all be all.
The internet still exists out there.
There will still be harm.
People still find harmful content on the internet.
And so if it's not unchanged, it's going to be found somewhere else, because that risk has been around for, you know, 20 plus years.
No one's talking about how we can censor the internet from having harmful content on it, or even thinking necessarily that's good because of free speech issues and yada yada.
So anyways, I just do think it's interesting.
I think that this is amazing, that opening eyes doing this, but I don't think it's the responsibility, if anything slips through the cracks or anything goes wrong, that necessarily they're at fault for any outcome of a person that is using it.
So, in any case, OpenAI said that parents will also be able to disable features like memory and chat history.
So apparently, this is something that has caused a bit of a problem.
Because, if it can remember, remember a lot of things about you.
They say that it like people build unhealthy relationships with these AI models.
Sometimes think of their friends.
I think that these steps are hopefully going to to make an impact.
I think one thing that is really interesting here is that they they said that they're going to be able to try and flag these moments of acute distress in real time.
They're going to try to add age appropriate model behavior rules.
And apparently they have already rolled out an in app reminder during long sessions to encourage people to take a break.
So this isn't something I've had.
I've never had long sessions of chat GPT.
I guess that have been long enough.
But I think if you're talking to it for hours, it will tell you that you should probably take a break.
It doesn't necessarily cut you off from using it, which again like if I was using chat GPT for some sort of work project and I needed it for like three hours straight and then all of a sudden it cut me off and forced me to be cut off, I'd be pretty annoyed at the product.
OpenAI said this is all part of a 120-day initiative where they're going to create a whole bunch of tools this year that they're hoping to make safer.
This is kind of the state of where OpenAI is with safety.
I know this is a really kind of controversial, challenging topic because there's, you know, real people's lives that have played into this.
Trying to you know balance my opinions and take on kind of what's happening here in a respectful way.
But hope you enjoyed the episode.
Thank you so much for tuning in.
Really appreciate all of you for for listening.
If you have any thoughts or comments, I would appreciate reviews on anything.
Thanks so much for Yeah, basically all you guys do hope that you all have a fantastic rest of your day.
