I'm Adrian Ma. Today, we've got a special guest episode for you.
It's an excerpt from a series called Who Broke the Internet from our colleagues up north at the Canadian Broadcasting Corporation.
It's from their Understood feed at CBC podcasts.
And the host is Cory Dr. Rho, you might've heard of him?
He's a journalist, blogger, science fiction writer and a internet commentator.
And his series digs into his criticisms on the state of the modern internet and what we can do about it.
So in this excerpt you're going to hear after the break, Corey's going to talk about how search engines got started.
Eventually the internet got too big for people to know where everything was, so waves of clever people created search engines.
Early search engines just looked for pages containing the words you typed, giving priority to pages that contained more of those words.
This worked okay, but when it failed, boy, did it ever fail badly.
If you wanted your page to rate high on the search results for a query like Mexican food, you could keyword stuff it by adding the words Mexican food a thousand times in tiny white on white type to the bottom of the page.
The primitive search engines would count these all up and conclude that your page was the most important Mexican food resource in the world which is useless because most hungry people aren't looking for a site that just has the words Mexican food a thousand times.
To weed these bad hits out of your search results you'd have to master all kinds of arcane search engine syntax so you could exclude words and putting minus signs in front of the kind of junk that was typical of spam sites.
It took forever, but those search engines were all we had, so we kept using them.
We were using really awful search engines that we thought were pretty good.
And you saw Google and all of a sudden the film cleared from our eyes, we thought, wow, you could actually find and what you were looking for on the internet right away.
Bang. This is Steven Levy.
He wrote the canonical history of Google in the Plex, how Google thinks, works, and shapes our lives.
Back in the early 90s, Stephen was Newsweek's tech reporter, and he knew right away that Google was a story.
When I first saw the Google search engine, my mind was blown.
So he tracked down their PR person.
I called her up, I said, I got to meet these guys.
These guys being Google's founders, two Stanford grad students named Larry Page and Sergei Brin.
So, Steven booked a ticket from New York to San Francisco and flew out to meet them.
It was near Halloween.
Everyone was dressed in Halloween costumes.
So, Larry was dressed like a Viking and Sergei was dressed like a cow.
He had these big plastic udders coming out from his chest. So, the Viking and the cow took me into a little room and explained how PageRank works.
PageRank is the algorithm behind the magic, a new way that Google had developed to deliver its search results.
It was totally audacious.
And I say audacious because the way that they were able to locate the best result for your query was by basically not basically literally downloading the whole web.
All of it, which some people thought was ridiculous, but Larry Page understood this could be done.
All Larry and Sergey needed to pull it off was big, powerful servers, which they could get because they had access to servers at Stanford. And they would literally hijack them as they came in the loading doc meant for other departments.
With all this yoinked power, they set up their first server, building the case for it out of LEGO.
Yeah, LEGO. Because it was cheap and cool and colorful, like the eventual Google logo.
And then they would do math, which was like Sergey's specialty, to analyze all the links that happened between websites, and figuring out what important websites link to other sites.
So that way, you could filter out which were the perfect answers for the queries you put into the search field.
And that turned to be just the quantum leap better than the previous things.
The early internet wasn't perfect.
Google came into existence because the search landscape sucked.
But the point is, Google could come into existence.
There was oxygen and sunshine that reached the forest floor so new things could grow.
If you could code, if you had some money, a computer or two, a couple of bins of Lego.
You could, you were allowed to build something new that made the web better.
Clive Thompson, again.
They start off by having a really good search engine, the best search engine.
And the reason why it's so good is that they are in ferocious competition with like 12 different search engines and they have to be better than everyone else.
They have to fight to the top, and they do that.
Just be the best. make the best product and people will switch. And we did.
We all switched to Google because it worked.
And that mattered to Google in their early days.
And there's the very famous motto that Google had, which don't be evil.
Which was coined by an engineer when someone from HR had a meeting.
And so what is our motto?
what is our value in this content?
And one guy said, what are you talking about?
It's just like, don't be evil.
I mean, that's it. So back in 1999, Stephen wrote that first story for Newsweek.
And he kept writing about Google.
Google's world was our world.
If things didn't exist, but it wasn't on the web.
It's like when Google did well, we all did well, because we could find the stuff we were looking for.
And that came into play even more when they came up with their first big successful business product.
And that was ads? Yeah.
When Google met advertising, everything changed.
The introduction of ads to Google marked a major shift. Emmanuel Goldstein again.
Google in their early days, you didn't have ads on the front page.
It was relatively fast and they just seemed like cool people inventing cool things.
Larry and Sergey actually hated advertising and the paper they wrote talking about page rank, they had a little thing in the hand, saying, well, we hate advertising.
It's terrible. Stephen's talking about an article that Google founders published in a journal in 1998 and And in it, they explicitly wrote that, quote, advertising income often provides an incentive to provide poor quality search results.
But they had to make money.
So then, they figured, well, maybe there's a way to do ads that wouldn't be terrible.
So in 2000, the founders assigned an engineer to figure this out, one of Google's first eight employees.
And he came up with something.
It's called AdWords.
So what it would do was when you put a query into the search engine, it would start an auction instantly.
And, you know, your search term would be auctioned off to advertisers who wanted to sell a product that was, you know, related.
If you search for Mexican food on Google back in the early aughts, The results would've been the most linked to websites for Mexican restaurants in your area and reviews from local blogs and newspapers.
And now with AdWords, ads would appear in a colored bar atop the normal page ranked results.
You get the same results but you get a little extra little set of possible results that actually might even help you if you were looking to buy something related to the search term and the advertisers would get an audience which you know, was primed to buy something.
And it worked for Google.
It works for advertisers and most of all, it worked for users that is until it didn't.
Thanks to our colleagues over at the Canadian Broadcasting Corporation.
If you want to hear more of Understood Who Broke the Internet, you can find a link in our show notes or find it wherever you listen to podcasts.
The original version of this episode was written and produced by Matt Mews, A .C.
Rowe and Corey Doctorow.
Roshani Nair is the coordinating producer.
Julian Uzzielli did the mixing and sound design.
Story editing by Veronica Simmons.
The executive producer is Nic McCabe -Lokos.
The indicator version of this episode was produced by Cooper Katz McKim and engineered by Cena Laffredo.
Kate Cannon is our editor and the indicator is the production of NPR.
