Serve AI agents an approved, machine-readable version of your site

When a verified AI crawler asks for a page, Agentic Web answers with the approved content in a compact, readable form: the facts, the price, the date it was verified and the source URL. People and search engines keep getting your normal site.

What it does

AI crawlers fetch your pages the way a browser would, then try to read a product out of navigation, scripts, cookie banners and collapsed panels. Agentic Web hands a verified crawler the approved version instead: a short, structured document with only what the source page says.

  • Served only to verified AI crawlers. Anything unverified gets the normal page.
  • Never served to search engines. Googlebot and other search crawlers always see your normal site.
  • Nothing the source page does not say. You approve every page before it is served.
ridgewell.example/nordwand-proGPTBotOAI-SearchBotClaudeBotPerplexityBot
What the bot fetched
<div class="pdp__hero js-lazy swiper" data-track="pdp:hero">
  <div class="swiper-wrapper"><div class="swiper-slide">…
<script>window.dataLayer.push({event:"view_item",…})</script>
<nav class="mega-menu mega-menu--desktop" aria-hidden="true">…
<div class="pdp__price"><span class="sr-only">Price</span>
  <span class="price price--sale" data-price="74900">…</span>
<div class="cookie-banner cookie-banner--v3">We value your…
<script type="application/ld+json">{"@type":"Product",…
<div class="pdp__specs accordion is-collapsed">…
… 2,140 more lines
What Agentic Web serves
# Cirrus Pro HS Hooded Jacket
Waterproof three-layer hardshell for alpine climbing.

- USD 749 · In stock · 470 g (size M)


Last verified: 2026-09-08 · Source: ridgewell.example/nordwand-pro
Served to GPTBot 4 min agoApproved content onlyRollback: v12 available

How it is installed

A small integration at your CDN or edge layer. On each request it checks whether the caller is a verified AI crawler and, if it is, serves the approved version of that page. The setup guide lists the currently supported providers.

  1. Connect your domain

    Add the domain in Bluemoon and choose which pages to include. Agentic Web reads them and drafts a machine-readable version of each, with the source URL attached.

  2. Approve the content

    Review each draft next to its source page. Edit, exclude or approve. Nothing is served until it has been approved.

  3. Enable it at your CDN or edge layer

    Add the integration from the setup guide. It runs on each request, verifies the crawler and returns the approved version only when verification passes. Every other request goes through untouched.

  4. Verify with the test tool

    From Bluemoon, confirm that a verified crawler receives the approved version of a page and that a normal browser receives the normal page, .

  5. Monitor

    Watch requests per crawler, what was served and what was later cited. Change detection tells you when a source page has moved on from its approved version.

Accuracy

The served version is a shorter way of saying what the page already says. Nothing is added.

  • Only approved content

    Every served page went through review. Drafts and excluded pages are never served, and a page you have not looked at yet is not served either.

  • A verified date and a source URL on every page

    Each served document ends with the date its content was last verified against the source and the URL it came from, so an agent can cite the page and a reader can check it.

  • Nothing the source page does not say

    No added claims, no rewritten prices, no summaries that go beyond the text. If the source does not state it, the served version does not either.

Freshness and rollback

Source pages change. The served version follows them only after you have looked.

Change detection
Each included page is re-read on a schedule. When the source differs from the approved version, the page is flagged for re-approval and you are told what changed.
Re-approval
You see the source change and the updated draft side by side. Approve, edit or exclude. Until you do, the last approved version keeps being served with its verified date, so a reader can see how old it is.
Versions
Every approved version is kept, with who approved it and when.
Rollback
Return any page to an earlier approved version in one step, for instance when a price change was approved too early.

Measurement

Serving a page is not the outcome. Being cited is. Both are counted, per crawler.

  • Served, per crawler

    Requests from each verified crawler, which pages they asked for and which approved version they received. Unverified requests are counted separately.

  • Served-to-cited rate

    Of the pages that were served, how many were later cited in the answers Bluemoon collects for your questions. Shown as a count with its denominator, per crawler and per engine.

  • Agent analytics

    Which crawlers visit, how often, which parts of the site they read, and what changed after a re-approval. Shown alongside your visibility data, not instead of it.

Limits

What Agentic Web does not do, and where it is available.

Availability by plan
PlanAgentic Web
Starter1 domain
Growth3 domains
Enterprise & GovernmentAll domains
EnterpriseBy contract

Questions before you enable it

Will search engines see a different page? Is this cloaking?
No. Search crawlers are never served the approved version; Googlebot and every other search crawler get your normal page. The approved version goes only to AI crawlers that pass verification, and it contains only what the source page already says. We do not promise any change in search ranking, up or down.
Which crawlers are recognised?
The AI crawlers of the answer engines Bluemoon reads, for example GPTBot, ClaudeBot and PerplexityBot. The current set is listed in your workspace and updated as operators publish changes.
What does an unverified request get?
Your normal page. A request that claims a crawler's user agent but does not match the operator's published IP ranges or reverse DNS is treated like any other visitor, and is counted separately so you can see how often it happens.
Does it run JavaScript or render my pages?
No. The served version is a static document approved by you. Content that only appears after scripts run on your page is not read, and the integration does not execute anything on the visitor's side.
Which CDN providers are supported?
The integration runs at your CDN or edge layer; the setup guide lists the providers currently supported and the steps for each. If yours is not listed, write to sales and we will tell you where it stands.

Become visible to AI agents, on your terms

Connect a domain, approve the pages, and enable the integration at your CDN or edge layer. Seven days free on any self-serve plan.