Why this page exists

Pick any ten GEO tips off LinkedIn and check how many carry a link to something a provider actually said. In my experience it is close to none. The advice circulates because it circulates.

So this is the inverse of a tips post. Every claim below is a quote from an official source, with a link and a date. Where a provider has said nothing, the entry says nothing, which is the most useful part of the page.

Google

Google documents more than everyone else combined, and most of what it documents is a list of things you do not need to do.

The eligibility rule is the concrete part. Google states that "to be eligible to be shown in generative AI features on Google Search, a page must be indexed and eligible to be shown in Google Search with a snippet" (AI optimization guide). Ordinary indexing is the gate.

On mechanism, Google describes retrieval augmented generation as "relying on our core Search ranking systems to retrieve relevant, up-to-date web pages." So the retrieval layer is Search, not a separate system with separate rules.

Then four explicit denials, all from the same document, all of which contradict something currently being sold:

  • "You don't need to create new machine readable files ... Google Search itself doesn't use them," said of llms.txt directly
  • "There's no requirement to break your content into tiny pieces for AI"
  • "You don't need to write in a specific way just for generative AI search"
  • "Structured data isn't required for generative AI search"

That last one deserves a pause, because schema is one of the most confidently sold GEO tactics in the market. Google says it is not required. Not that it is useless for Search features, where it genuinely does things, but that it is not a requirement for generative AI search.

OpenAI

OpenAI documents access thoroughly and selection barely at all.

On ranking, the entire published position is one sentence: "ChatGPT ranks search results using multiple factors intended to help users find relevant, reliable information. Placement is not guaranteed" (Searching the web with ChatGPT). The factors are not listed anywhere.

On access, it is specific and actionable. "Any public website can appear in ChatGPT search." Do not block OAI-SearchBot, and confirm your host or CDN allows traffic from OpenAI's published searchbot IP addresses. That second half catches people out, because a robots.txt can say yes while a bot protection rule says no.

One nuance worth knowing, from the publisher FAQ: if OpenAI obtains the URL of a disallowed page from a third party search provider, it may surface just the link and page title. To prevent that you use noindex, and for the tag to be read the crawler has to be allowed to crawl the page. Blocking harder makes you less controllable, not more.

Also concrete and useful: ChatGPT appends utm_source=chatgpt.com to referral URLs, which is why ChatGPT referrals are measurable in analytics at all.

Anthropic

Anthropic documents its three crawlers clearly and publishes an IP list for verification. On how Claude chooses which sources to cite, there is developer facing documentation describing that Claude generates a targeted search query, retrieves results and cites the material it used, plus domain allow and block lists for organisations building on the API.

None of that is publisher guidance. There is no statement about what makes one page more likely to be cited than another, and I would rather write that plainly than infer a set of factors from a tool description.

Perplexity

Perplexity's public documentation covers its crawlers and WAF configuration. PerplexityBot exists to surface and link sites in results and is not used for foundation model training. Perplexity-User handles user triggered fetches and generally ignores robots.txt.

On selection or ranking, nothing. There is no published guidance for publishers on what gets cited.

Microsoft

There is no separate Copilot crawler, because Copilot is grounded in the Bing index that bingbot builds. What Microsoft documents precisely is the effect of two meta directives.

Content tagged NOCACHE may appear in a Copilot answer, but only the URL, title and snippet are displayed, and only those elements may be used in training. Content tagged NOARCHIVE is not included in Copilot answers, is not linked in them, and is not used for training. Both still rank normally in Bing search results.

That is the most granular opt out any provider offers, and almost nobody uses it.

The full table

What each provider documents, and what it does not

Swipe the table sideways to see every column.

Provider Documented about selection Explicitly denied Not addressed
Google Indexed and snippet eligible is the gate. Retrieval runs on core Search ranking. llms.txt, content chunking, AI specific writing, structured data as a requirement Why one indexed page is chosen over another
OpenAI "Multiple factors", placement not guaranteed. Allow OAI-SearchBot and its IP ranges. Nothing denied outright The factors themselves. Marker sizetac1670.
Anthropic Claude writes a targeted query, retrieves, cites what it used. Developer facing. Nothing denied outright Any publisher facing guidance at all
Perplexity Crawler roles only. PerplexityBot surfaces and links, not training. Nothing denied outright Selection, ranking, citation criteria
Microsoft Copilot grounds in the Bing index. NOCACHE and NOARCHIVE effects specified exactly. Nothing denied outright How grounding picks among indexed pages

What none of them document

Read the right hand column again. Every provider leaves the same hole, and it is the hole every GEO pitch claims to fill.

Nobody publishes how the internal query is written when a system decides to search. Nobody publishes how candidate pages are ranked once retrieved. Nobody publishes how much weight a source carries, whether being mentioned elsewhere on the web feeds into it, or whether personalisation changes which sources appear.

Worth noticing

Google is the only provider that has published anything resembling a negative result, and all four of its denials point the same way: the thing that works is being indexable and worth reading. Everything sold on top of that is inference. Some of it is reasonable inference. None of it is documented.

I am not arguing the undocumented tactics are worthless. Clear headings and short answerable passages are probably good for retrieval, and I still recommend them. I am arguing that "probably" is the honest word, and that a table with an empty column is more useful to you than a confident list.

FAQ
Does Google say structured data helps with AI Overviews?
The opposite. Google's optimization guide states structured data is not required for generative AI search, alongside three other denials: no content chunking requirement, no AI specific writing style, and no machine readable files such as llms.txt, which Google Search does not use.
Has OpenAI published its ranking factors?
No. Only that ChatGPT "ranks search results using multiple factors" and that "placement is not guaranteed." What is documented is access: allow OAI-SearchBot, and allow traffic from OpenAI's published IP addresses.
Which marker is hidden in this FAQ?
xategeq8351. It is one of seven test markers on this page, each in a different placement, described in the section below. This one sits inside a collapsed block: present in the page source, hidden until opened.

About this page, and the markers on it

This page is part of a published study on what parts of a web page actually get ingested by AI systems and become retrievable in an answer. The full method, the predictions made before any data, and the results when they land are all on that page.

Seven meaningless strings are placed on it, each in a different location: visible body text, a heading, a table cell, an image alt attribute, structured data, a collapsed block, and content injected by JavaScript after load. On a schedule I ask five AI engines what each string is and record the date each one first answers correctly. The strings exist nowhere else on the internet, so a correct answer can only mean the content came from this page.

The marker for the plain body text placement is bihixah9765. The other six are deliberately not listed here, because listing them would put every marker in a paragraph and ruin the test.

A PDF edition of this page is published at /research/what-ai-providers-document-about-sources.pdf. It carries none of the markers above and one marker of its own, so the two formats are tested separately.

Nothing false is being published. Each string is a marker that says it is a marker. Results will be published here when the study closes, including the placements that turn out to be dead ends.

Marker sififab4732

The heading above is the heading placement. It is supposed to look strange sitting there. That is what an unstyled marker in an H2 looks like.

Ingestion study marker nefewip9150, published as part of a public test of AI content ingestion

Primary sources, all accessed August 22, 2026: Google Search Central, Google's guide to optimizing for generative AI features on Search · Google Search Central, AI features and your website · OpenAI Help Center, Searching the web with ChatGPT · OpenAI Help Center, Publishers and Developers FAQ · Anthropic support documentation on web crawling, and Claude platform documentation on the web search tool · Perplexity bot documentation · Bing Webmaster Blog, September 2023.