When you typed who is on snl tonight? You used to get 10 pages of clickbait that made you scroll down endlessly for the answer. The best product for most questions is to just give you the answer. That said, the death of discovery is worth mourning. I hope someone solves it but this was dying before ai came along. SEO killed the web, AI killed SEO, and so it goes…
> When you typed who is on snl tonight? You used to get 10 pages of clickbait that made you scroll down endlessly for the answer.
Right. Why? That's a nightmare that Google built for us. They lined the pockets of SEO spammers, and because it was their business, they made talked the talked but were never willing to truly deal with the problem.
But even in your SNL example, to show you the answer, Google AI needs to take it from someone who actually made an effort to put this information online. Network programming is an rare corner case where the person doesn't mind the bot slurping it up because the goal is to get people to watch SNL, not to visit a website. But there is so much non-commercial content on the internet that is really getting hosed right now, and that people probably simply won't be putting online anymore because they don't want to do free labor for OpenAI or Google.
As a practical example, there's a lot of hobby historian communities dedicated to specific places, periods, or types of collectibles, and the only reason they exist is to bring people together and share their finds and wisdom. If you're a historian of Kinder Surprise toys or old military uniforms or whatever, and Google is now taking your work without letting you connect with like-minded individuals, there's really little incentive left.
I want to argue against you, but I just can't. Beyond the hyperbole, maybe we are on the cusp of change. Stuff being posted is AI slop, but maybe it is the Geo Cities obnoxious site of 1999, when an person does it because they want it and not a content farm.
Is there anything after AI though? As long as we allow AI to benefit individual people, we seem headed to an ad-free custom GUI future.
As you say, it has already started with AI rewriting web results into a focused text response--a text interface.
Frontier AI models have started drawing little diagrams and creating little interactive apps that go along with whatever they're trying to demonstrate. They also extract images from--well, from somewhere, the web I assume?--and placing those images in their text responses.
I've been using AI to write custom widgets for the game Beyond All Reason (which is open source and allows custom widgets), and it's great even with this obscure API. It can turn ideas into beautiful custom graphics easily.
I don't want to see your ads, or even your webpage. I just want the information.
Maybe with AI everywhere we can finally do some sort of micropayments where the AI can distribute a fixed amount of money on my behalf. I am willing to directly pay a small amount for casual browsing.
well.. that really wasn't my experience. when you put "who is on snl tonight," you would get a top row of news stories related to that, probably in this case some (admittedly low effort) post saying "Catch Tom Holland on SNL this Saturday!"
that said, it's true that SEO did kill even that, because the headlines began to be "You won't believe who tonight's SNL headliner is" and they even keep the name out of the slug too.
# You won't believe who tonight's SNL headliner is.
## Someone is hosting SNL this week.
In this article we will tell you who is hosting SNL this week.
### What is SNL?
SNL, or Satruday Night Live, is a sketch comedy show that originated back in...
### A brief history of sketch comedy
...
### Past SNL hosts
...
### This week on SNL
<this section still does not say who is hosting this week>
...
...
...
...
---
This almost every webpage/blog post I've found through a search engine since around 2016 (I remember around that time every single time I'd search something about React, every article would start with many paragraphs describing what React is).
Anyway, ya. People say that nostalgia for the "old web" is just that (nostalgia). I disagree, but ya.
If Google didn’t put those there, people would be going to other LLMs to get their answers quickly. I don’t know how this ends but I strongly doubt any unilateral effort to withhold llm service by Google changes the medium term outcome.
I think it's actually wise of Google to disrupt themselves this way. If they don't the AI companies will do it for them, and they'll have no control over the process nor chance to recover lost ad income. As per the article, Google managed to pull this off without hurting ad revenue (surprise!)
Disclaimer: I wrote the blog post and submitted it
Is the future of providing content hosting markdown files and images surfaced with a sitemap xml file exposed to LLM providers, or perhaps just offering an mcp?
I sure hope so. My AI agent should be my user agent for web access. Some times I want things summarized, other times I want a specific page, and other times I want recommendations for adjacent topics. But in all cases I want my agent to serve information the way I ask for it.
Exactly, people treated Google like it was AI long before the rise of LLMs. Now they actually get the answer they're looking for rather than searching through a sea of web links.
I mean, they are going to google search specifically because it isn't an LLM. What is the point of shoving AI there when you already have your Gemini offering as your actual competing product with LLM? Adding AI to the search product just dilutes both product and probably pisses off both the users who come to google search to expect google search, as well as the people comfortable with LLM answers who are getting the inferior "search blurb llm" instead of the actual Gemini offering and walking away with a sour taste in their mouth about google and their LLM capabilities as a result.
If you want to win the war on AI search you just have to have a browser and an LLM answering all search queries. I don't really care who's behind the answer as long as it is right (which 99% of the time it is) so there is no loyalty at all, no need to switch, no need to try the competition, nothing. AI is the answer and it will get better with time
I use Brave, I don't know if it uses Leo (brave search) or gemini, or chatgpt, I just know the answers it gives me are the ones I am looking for and most of the time I extend the conversation with some of the options offered, hardly click on any link below the answer provided (which most of the time those links are garbage)
It’s a broad representation of US search, not a spam-focused list. But it does have some biases.
They source it via Google Ads and Bing Ads services. In practice, they grow the list by asking Google’s Keyword Planner for related terms and collecting things like “related searches” from results pages. But sourcing keyword queries like this tends to skew to queries with commercial value, reflecting what advertisers care about.
Google's AI solved a fundamental flaw with old search engines. SEO broke the internet over and over. AI... LLMs being used for searching information is really a good thing.
It's not that. People have purchased autocomplete traffic and filled all search results with fake generated things. Since TPU's are at 16,000 tokens per second, by the time you hit enter and the page loads, every single site is fake.
You can try any search on any subject and every single site generated is fake.
Somehow, they have also managed to get copies of some emails, and impersonate the sender and send fake emails too.
Here is an example of a real email I got from a real sender:
Hello Robert,
While reviewing engineers building practical AI-powered products, your recent work developing and operating public AI services stood out, particularly your deployment of a quantized Qwen model on CPU infrastructure and your work coordinating AI coding agents to build, test, and deploy functioning applications.
I'm (name), an Independent Career Advisor Consultant. I'm reaching out regarding a specialist mandate focused on AI product engineering and applied agent systems, where your experience building AI-enabled applications and your expertise in local model deployment, Qwen, agent-assisted software development, browser applications, operational controls, and production deployment appear particularly relevant to the expertise being sought.
I'd be pleased to share a brief overview or relevant listing for your review. Should the mandate align with your interests, I can guide you in positioning your experience against its requirements and developing tailored application materials before you move forward.
Would you be open to reviewing the details?
Best regards,
(name)
It's meticulously and very carefully written, after a complete review of my technical portfolio. The person who wrote it looked through my Github and publications, and is a senior hiring manager level person.
However, when I replied saying yes, I received this impersonation sent shortly after my message. As you can see it's obviously completely AI-generated and completely fake.
"
Hello Robert,
Following your interest, I have identified four opportunities that align with your experience in AI-powered application development, autonomous systems, local model deployment and AI assisted software engineering.
Here are the positions for your consideration:
1. Senior Software Engineer – AI Agents
Company: Traba
Location: New York / San Francisco, USA
Work arrangement: Not specified in the posting
Expected salary: $200,000–$240,000 annually, plus equity.
2. Senior AI Engineer – Multi-Agent Frameworks
Company: ClickUp
Location: United States
Work arrangement: Fully Remote
Expected salary: $200,000–$250,000 annually, plus equity.
3. Senior AI Engineer – Core
Company: Hilbert's AI
Location: San Francisco, California
Work arrangement: Hybrid
Expected salary: $180,000–$215,000 annually, plus potential bonus and equity.
4. AI Forward Deployed Engineer
Company: Regal
Location: New York, USA
Work arrangement: Hybrid
Expected salary: $135,000–$180,000 annually, plus equity and potential variable compensation.
I have prioritised opportunities involving practical AI implementation, agent-based systems, software development and the deployment of AI-powered products.
Which one or two of these opportunities would you be most interested in pursuing?
Once you identify your preferred positions, I can help you review their requirements and prepare your application materials accordingly.
"
It looks like a human scammer might have lightly edited this text, which is obviously completely AI-generated.
So not only has AI filled the entire Internet with total useless crap, scammers have managed to buy access to private emails and redirect real inquiries to their worthless scamming.
Right now, everyone says it's a good thing. You have a question, you get your answer. Done!
The problem is when you don't visit the website where the answer came from, they start believing that no one cares about that information, and stop contributing. Give it enough time and the only answers we get will be from tweets. And they will be as reliable as you can imagine.
That was my guess too, but it seems like Google pulled it off so far. Clicks on ads didn't change, so Google is taking care to not cannibalize their own revenue.
Did they do unsustainable things that hurt their advertisers in order to temporarily goose ad clicks and earnings? Almost certainly, and I've heard anecdotes about that.
Google web search's goal has always been to get answers in front of eyeballs. It has never been to drive traffic to sites. Ads and Search are different product areas. But nobody believes these things.
Yes this sucks for the open web but anecdotally we've been getting new clients cold off of, apparently, chatgpt. I guess it ingested info about our co-op and has been recommending it to people that ask it for agencies? I would love to know what made us attractive to the LLMs so I could advise clients on same, but I have no idea! My best guess is just having lots of FOSS projects and generally trying to make useful blog posts rather than SEO slop. So... basically the same as the old "actually good" SEO advice.
I'm somewhat conflicted about AI overviews. On one hand, as other comments mention, if Google didn't disrupt themselves, others would. Also, and this is just a personal anecdote (but it jives with some of the data in this article), but the primary times that AI overviews keep me from clicking through is when I just want an answer with information (and sometimes I will click through if it's to a site that looks high quality). So it would appear the sites that get hurt the most are content spam or at least "content spammy" sites that try to draw you in with usually mediocre content to buy something else or show you ads.
But at that the same time, Google is now just vacuuming up all the revenue that used to go to other sites, and that feels blatantly unfair to me (remember back in the day when Larry Page said "We want to get you out of Google and to the right place as fast as possible"? My how times have changed). This is one reason why there is so much general distrust of these tech giants: they start out all "Hey, look how mutually beneficial this all is" and then ends up at "I am altering the deal. Pray I don't alter it any further."
what's the logical terminus of this? Google doesn't have feet on the ground, real world reviews, reports, testing of products, material ground truth comes from people who rely on traffic. This is self-defeating in the end because Google won't have anyone to syphon data from.
It's basically what happened to local news when it got eaten by social media, now you have no real world reporting any more, you just have some Simulation & Simulacra world where people and bots yell into the void on twitter
Right. Why? That's a nightmare that Google built for us. They lined the pockets of SEO spammers, and because it was their business, they made talked the talked but were never willing to truly deal with the problem.
But even in your SNL example, to show you the answer, Google AI needs to take it from someone who actually made an effort to put this information online. Network programming is an rare corner case where the person doesn't mind the bot slurping it up because the goal is to get people to watch SNL, not to visit a website. But there is so much non-commercial content on the internet that is really getting hosed right now, and that people probably simply won't be putting online anymore because they don't want to do free labor for OpenAI or Google.
As a practical example, there's a lot of hobby historian communities dedicated to specific places, periods, or types of collectibles, and the only reason they exist is to bring people together and share their finds and wisdom. If you're a historian of Kinder Surprise toys or old military uniforms or whatever, and Google is now taking your work without letting you connect with like-minded individuals, there's really little incentive left.
It feels like the web has just become either social media or AI. There isn't any room for smaller sites to find users anymore.
Everything is a private app, or walled-garden served over HTTP/s.
The web now is mostly an ecommerce platform with Google being an e-commerce search engine.
The web of late 1990’s early 2000’s is dead. Sadly,
Is there anything after AI though? As long as we allow AI to benefit individual people, we seem headed to an ad-free custom GUI future.
As you say, it has already started with AI rewriting web results into a focused text response--a text interface.
Frontier AI models have started drawing little diagrams and creating little interactive apps that go along with whatever they're trying to demonstrate. They also extract images from--well, from somewhere, the web I assume?--and placing those images in their text responses.
I've been using AI to write custom widgets for the game Beyond All Reason (which is open source and allows custom widgets), and it's great even with this obscure API. It can turn ideas into beautiful custom graphics easily.
I don't want to see your ads, or even your webpage. I just want the information.
Maybe with AI everywhere we can finally do some sort of micropayments where the AI can distribute a fixed amount of money on my behalf. I am willing to directly pay a small amount for casual browsing.
snort, No, you will get ads. It will be all ads eventually. It always turns into ads.
that said, it's true that SEO did kill even that, because the headlines began to be "You won't believe who tonight's SNL headliner is" and they even keep the name out of the slug too.
## Someone is hosting SNL this week.
In this article we will tell you who is hosting SNL this week.
### What is SNL?
SNL, or Satruday Night Live, is a sketch comedy show that originated back in...
### A brief history of sketch comedy
...
### Past SNL hosts
...
### This week on SNL
<this section still does not say who is hosting this week>
...
...
...
...
---
This almost every webpage/blog post I've found through a search engine since around 2016 (I remember around that time every single time I'd search something about React, every article would start with many paragraphs describing what React is).
Anyway, ya. People say that nostalgia for the "old web" is just that (nostalgia). I disagree, but ya.
https://www.theverge.com/24167865/google-zero-search-crash-h...
Disclaimer: I wrote the blog post and submitted it
https://github.com/gordonbrander/zim-mcp as an example reference implementation
My local search interface can then be models updated over time with diffs via torrents, plugged into mcps for grounding and context not yet in models.
https://pirateface.co/articles/pirate-face-cli
https://huggingbay.xyz/
I use Brave, I don't know if it uses Leo (brave search) or gemini, or chatgpt, I just know the answers it gives me are the ones I am looking for and most of the time I extend the conversation with some of the options offered, hardly click on any link below the answer provided (which most of the time those links are garbage)
As a user, I am happy to see content spam trash to die and burn in hell.
They source it via Google Ads and Bing Ads services. In practice, they grow the list by asking Google’s Keyword Planner for related terms and collecting things like “related searches” from results pages. But sourcing keyword queries like this tends to skew to queries with commercial value, reflecting what advertisers care about.
Disclaimer: I wrote the article
Honestly. Its as good these days.
You can try any search on any subject and every single site generated is fake.
Somehow, they have also managed to get copies of some emails, and impersonate the sender and send fake emails too.
Here is an example of a real email I got from a real sender:
Hello Robert,
While reviewing engineers building practical AI-powered products, your recent work developing and operating public AI services stood out, particularly your deployment of a quantized Qwen model on CPU infrastructure and your work coordinating AI coding agents to build, test, and deploy functioning applications.
I'm (name), an Independent Career Advisor Consultant. I'm reaching out regarding a specialist mandate focused on AI product engineering and applied agent systems, where your experience building AI-enabled applications and your expertise in local model deployment, Qwen, agent-assisted software development, browser applications, operational controls, and production deployment appear particularly relevant to the expertise being sought.
I'd be pleased to share a brief overview or relevant listing for your review. Should the mandate align with your interests, I can guide you in positioning your experience against its requirements and developing tailored application materials before you move forward.
Would you be open to reviewing the details?
Best regards, (name)
It's meticulously and very carefully written, after a complete review of my technical portfolio. The person who wrote it looked through my Github and publications, and is a senior hiring manager level person.
However, when I replied saying yes, I received this impersonation sent shortly after my message. As you can see it's obviously completely AI-generated and completely fake.
" Hello Robert,
Following your interest, I have identified four opportunities that align with your experience in AI-powered application development, autonomous systems, local model deployment and AI assisted software engineering.
Here are the positions for your consideration:
1. Senior Software Engineer – AI Agents
Company: Traba
Location: New York / San Francisco, USA
Work arrangement: Not specified in the posting
Expected salary: $200,000–$240,000 annually, plus equity.
2. Senior AI Engineer – Multi-Agent Frameworks
Company: ClickUp
Location: United States
Work arrangement: Fully Remote
Expected salary: $200,000–$250,000 annually, plus equity.
3. Senior AI Engineer – Core
Company: Hilbert's AI
Location: San Francisco, California
Work arrangement: Hybrid
Expected salary: $180,000–$215,000 annually, plus potential bonus and equity.
4. AI Forward Deployed Engineer
Company: Regal
Location: New York, USA
Work arrangement: Hybrid
Expected salary: $135,000–$180,000 annually, plus equity and potential variable compensation.
I have prioritised opportunities involving practical AI implementation, agent-based systems, software development and the deployment of AI-powered products.
Which one or two of these opportunities would you be most interested in pursuing?
Once you identify your preferred positions, I can help you review their requirements and prepare your application materials accordingly.
"
It looks like a human scammer might have lightly edited this text, which is obviously completely AI-generated.
So not only has AI filled the entire Internet with total useless crap, scammers have managed to buy access to private emails and redirect real inquiries to their worthless scamming.
The problem is when you don't visit the website where the answer came from, they start believing that no one cares about that information, and stop contributing. Give it enough time and the only answers we get will be from tweets. And they will be as reliable as you can imagine.
I suspect advertisers might disagree.
Did they do unsustainable things that hurt their advertisers in order to temporarily goose ad clicks and earnings? Almost certainly, and I've heard anecdotes about that.
Disclaimer: I wrote the article
Clicks on ads didn't change, which suggests Google takes care not to cannibalize its own revenue.
But at that the same time, Google is now just vacuuming up all the revenue that used to go to other sites, and that feels blatantly unfair to me (remember back in the day when Larry Page said "We want to get you out of Google and to the right place as fast as possible"? My how times have changed). This is one reason why there is so much general distrust of these tech giants: they start out all "Hey, look how mutually beneficial this all is" and then ends up at "I am altering the deal. Pray I don't alter it any further."
It's basically what happened to local news when it got eaten by social media, now you have no real world reporting any more, you just have some Simulation & Simulacra world where people and bots yell into the void on twitter