I was on a call when an editor said, “We’re ready to shut Google out.” The room went quiet—this was not a threat; it felt like a threat to the pipes that feed millions of readers. You could feel the choice tightening into a single, risky question.
I’ve covered newsroom fights over ads, paywalls and platform deals. Now the fight is over search and the way Google’s AI takes what publishers make and turns it into quick answers. You should know what’s at stake and what moves are actually possible.
A Reddit product lead described a boardroom debate about cutting access. The change would reverse a deal that gave Google steady content for its AI.
The Wall Street Journal says publishers are weighing whether to stop Google’s crawlers from using their pages to feed AI results. Reddit, which signed a deal to let Google scrape its posts for AI and reportedly gets paid about $60,000,000 per year (€55,000,000), has talked about pulling access. That would be a sharp turn.
Other names in the report: Reuters’ president saying they’re “certainly weighing the economic trade‑offs between search and AI summaries,” Mike Reed of USA Today saying “enough is enough,” and Neil Vogel of People, Inc. telling WSJ “Turning them off and blocking them entirely is 100% on the table.” Politico and The Economist are also reviewing crawl rules.
Can publishers block Google from using their content for AI?
Short answer: yes, but with caveats. There are bot signals and meta tags that change how Google treats a page. Tools like BotDetector have documented differences between Googlebot and the so‑called Google‑Extended behavior. Blocking the extended feature is supposed to stop your pages from being included in training datasets for Gemini‑class models and to reduce insertion into AI Overviews.
An editor at a mid‑sized outlet pulled up their CMS and showed me the tag options. The choices range from mild controls to nuclear ones.
There are at least three practical levels to restrict Google:
- Block Google‑Extended and other special crawler flags — a surgical option aimed at AI training.
- Add
nosnippetto stop AI Overviews from quoting your content, which can harm discoverability. - Apply
noindexto prevent search indexing entirely — the most extreme move and the one that would erase your pages from Google Search results.
Google told WSJ its AI sends “billions of clicks to the web every week,” and that it “highlights links to the web and helps creators and publishers grow their audiences,” while offering controls for site owners. Whether those clicks replace or cannibalize organic search traffic is the core of the dispute.
What happens if publishers use noindex?
If you set noindex, Google won’t list your pages in search. That cuts off a steady stream of discovery: evergreen articles, referral traffic, subscriber acquisition funnels. For some outlets that rely heavily on search referrals, it could be like turning off a faucet. For others, it might be a deliberate gamble to protect brand and paid readership.
A CEO told me, on background, “We’re ready to turn the switch.” The tone I heard was defensive and strategic at once.
Publishers are weighing revenue and control. If a critical mass moves to block Google, you’d see a rapid shift in how readers find journalism. Blocking entirely is like severing a bridge between your content and the wider web; applying nosnippet is more like drawing a blackout curtain over snippets while leaving the streetlight on for search.
Either way, the calculus is simple: preserve content value and paywall integrity, or accept the traffic that feeds ad and subscription funnels. That’s why the debate has CEOs and product teams involved, not just legal or editorial staff.
Will blocking Google hurt traffic and revenue?
Probably, at least at first. Google’s systems do send clicks back to publishers, and some sites depend on that flow for ad impressions and subscriber conversions. But publishers who feel AI summaries are siphoning loyalty or undercutting subscription value believe the long‑term trade‑off may favor control over instantaneous reach.
Tools and signals matter. Blocking Google‑Extended or adding nosnippet can reduce AI reuse with less search fallout; noindex is blunt and immediate. You can test, monitor referral swings, and scale your controls, but every move has second‑order effects on SEO, brand visibility and partner revenue.
I’ll keep watching how Reuters, Reddit, Politico, The Economist, USA Today and others act. You can plan for incremental controls or prepare for a dramatic break — either way, your choice will change how the web finds news and who profits from it. Which path will you bet the newsroom on?