Back to Research
citedby Research · Answer Engine Optimization

How We Got ThriveStack Content Indexed and Cited in Google AI Overviews

Answer engine optimization is the work of getting your pages crawled, indexed and cited by AI engines like ChatGPT, Google AI Overviews and Perplexity.
  • The foundation: a page an AI crawler can read, and an index it can be pulled from.
  • Over eight weeks we tracked indexing across 199 pages on Google and Bing.
  • Found and fixed ten issues across sitemaps, indexing, metadata and links.
  • Indexing climbed from 42 to 192 pages.
  • AI bot crawls rose from about 1,500 to over 40,000 a month.
  • Pages cited by AI grew from 2 to more than 100.
ChatGPTChatGPTGoogle AI OverviewsGoogle AI OverviewsPerplexityPerplexityGeminiGemini
4,900%
increase in pages cited by AI (2 to 100+)
40k+
AI bot crawls a month, from ~1,500
192/199
pages indexed on Google (96%)
Sep 2026 · 9 min read · Informational · Case study

Getting cited in a Google AI Overviews starts somewhere unglamorous: getting your pages indexed, because an AI engine can only cite what it has already stored. Over eight weeks we took ThriveStack from 2 pages ever cited to more than 100, and AI bot crawls from about 1,500 to over 40,000 a month.

2 to 100+
pages ever cited by AI
27x
more AI bot crawls a month
192
of 199 pages indexed on Google
~6k
human impressions a month
01 · The plan

Our step-by-step execution plan to win AI search visibility

We won them one query type at a time: first brand and category, then vertical, informational and comparison. Each type needed its own pages, its own posts, and a positioning pass to keep the story straight. We worked from a library of the buyer questions and AI search prompts we wanted to win, one topic at a time rather than chasing everything at once. Try the prompt research →

The order ThriveStack won AI prompts, and what comes next
Each numbered play, what we did, and the result. Won plays first, then what is planned.
  1. 1
    SEO and technical fixesFoundation
    The groundwork under every play: fixed sitemaps, indexing and server-side rendering so AI crawlers can read every page, and shaped the content answer-first so it is ready to be cited. Run the AI brand visibility checklist →
  2. 2
    Brand and categoryOne story
    Re-aligned positioning across LinkedIn, the website and G2 so every engine tells one story. citedby flagged where the message had drifted. See our research on AI trust signals.
  3. 3
    Vertical+5%
    GSC and GA4 showed buyers searching by vertical, so we built tailored landing solutions for retail banking, universities and .edu, local SEO agencies and airlines, then engaged in communities on LinkedIn and Reddit.
  4. 4
    Informational+3%
    Published glossary terms and GEO-myth pages to systematically answer informational-intent queries across AI engines.
  5. 5
    Comparison+6%, 23 customers moved
    Head-to-head queries: ThriveStack vs Otterly (Otterly alternative), citedby vs Peec (Peec AI alternative), ThriveStack vs Profound. Commercial intent beat informational, and 23 customers moved to ThriveStack citedby.
  6. 6
    G2 reviews+4% MoM ↑
    Drove and cited fresh G2 reviews as earned media that AI engines can read. About 30 new reviews came in, lifting AI visibility about 4% and still improving month over month. See ThriveStack citedby on G2 →
  7. Now · Sep 2026
Source: ThriveStack citedby prompt tracking, Jul to Sep 2026.
The biggest lesson: commercial-intent queries beat informational ones. The comparison plays (ThriveStack vs Otterly, citedby vs Peec, ThriveStack vs Profound) lifted AI visibility about 6% and moved 23 customers to ThriveStack citedby. A buyer asking 'which tool is better' is ready to switch, so we now win the comparisons first.
02 · The foundation

Why does AI search indexing decide whether you get cited?

Because an answer engine can only cite a page it has already crawled and indexed. If ChatGPT or Google AI never fetched your page, you are not in the running, however good the writing is.

Google states this plainly. To appear as a supporting link in an AI Overview, a page must be indexed and eligible to show in Search. No index entry means no citation.

There is a second trap. Most AI crawlers do not run JavaScript. A Vercel analysis found that OpenAI, Anthropic and Perplexity bots fetch script files but do not execute them, causing client-side ghosting where content drawn in by JavaScript is invisible to them. The page has to render its content on the server. Google AI is the exception, since it reuses Googlebot rendering.

The order is fixed: crawl, then index, then retrieve, then cite. Everything in this report works one step at a time, from the bottom.
An answer engine can only cite a page it has already indexed
The four steps between a live URL and an AI citation
1. Crawl

A bot fetches the page. Most AI bots skip JavaScript.

2. Index

The page is stored and made retrievable.

3. Retrieve

Pulled to help answer a user's prompt.

4. CiteGoal

Appears as a linked source in the AI answer.

Google Search Central; Vercel AI crawler analysis, 2025.
Source: Google Search Central; Vercel AI crawler analysis, 2025.
03 · Google

How to get indexed by Google for AI answers?

You inspect every URL through the Search Console URL Inspection API, read the coverage state, and request a crawl for anything not indexed. We ran this against all 199 URLs on a daily loop, with service-account auth so it never needed a login.

The API returns a clear status for each page. We sorted them and acted on the gaps.

#Coverage stateWhat it meansWhat we did
1Submitted and indexedLive and citableNothing
2Discovered but not indexedKnown but queuedLeft it in the crawl queue
3Crawled but not indexedSeen but droppedRequested indexing again
4URL unknown to GoogleNever discoveredRequested indexing in the browser

Brand-new pages often land as URL unknown to Google. The API cannot push those, so we requested indexing manually in Search Console through the browser, automated with Claude driving Chrome. Both new pages were indexed within about a day.

Confirmed indexing climbed from 42 to 192 pages over eight weeks
47 AUDIT RUNS
GSC indexation funnel, all 47 daily audit runs scaled to the 199-page sitemap (Jul 30 – Sep 17, 2026)
Audit Runs
47 Daily Runs
Sitemap Size
199 URLs
Indexing Progress
42 → 192 pages
Coverage Lift
21.1% → 96.5%
Indexed (>190)
Discovered / Queued
Unknown to Google
Jul 30
21.1%
Jul 31
21.1%
Aug 1
21.6%
Aug 2
22.1%
Aug 4
23.1%
Aug 5
24.1%
Aug 6
25.1%
Aug 7
26.1%
Aug 8
27.1%
Aug 9
28.6%
Aug 11
60
30.2%
Aug 12
64
32.2%
Aug 13
68
34.2%
Aug 14
72
36.2%
Aug 15
77
38.7%
Aug 16
82
41.2%
Aug 17
98
49.2%
Aug 18
115
57.8%
Aug 19
121
60.8%
Aug 20
126
63.3%
Aug 21
130
65.3%
Aug 22
135
67.8%
Aug 23
148
74.4%
Aug 25
150
75.4%
Aug 26
151
75.9%
Aug 27
152
76.4%
Aug 28
154
77.4%
Aug 29
155
77.9%
Aug 30
156
78.4%
Aug 31
158
79.4%
Sep 1
159
79.9%
Sep 2
160
80.4%
Sep 3
162
81.4%
Sep 4
165
82.9%
Sep 5
168
84.4%
Sep 6
171
85.9%
Sep 7
174
87.4%
Sep 8
183
92.0%
Sep 9
184
92.5%
Sep 10
185
93.0%
Sep 11
186
93.5%
Sep 12
188
94.5%
Sep 13
189
95.0%
Sep 14
190
95.5%
Sep 15
191
96.0%
Sep 16
191
96.0%
Sep 17
192
96.5%
ThriveStack indexing tracker, live GSC URL Inspection API, Jul to Sep 2026.47 / 47 runs verified
Source: ThriveStack indexing tracker, live GSC API, full dataset of 47 audit runs, Jul to Sep 2026.
04 · Bing

Can Bing Webmaster API speed up indexing for ChatGPT citations?

Yes, indirectly. It pushes your URLs straight into Bing's crawl queue instead of waiting to be found, and ChatGPT search is widely reported to read Bing's index. We submitted pages in batches through the Bing URL Submission API, which returns a plain success and costs nothing against a 10,000-a-day quota.

Bing matters more than its search share suggests. ChatGPT search draws on third-party search providers, widely reported to include Microsoft Bing, alongside OpenAI's own crawler and licensed content. A page Bing has crawled has a second path to an AI answer.

Bing crawls new pages slower than Google. Our two newest pages were indexed on Google in a day but sat uncrawled on Bing for more than five days, even after submission. That gap is normal and worth planning around.
05 · The bugs

What sitemap bugs block generative engine optimization?

Ten did, and they fell into four groups: discovery, indexing, metadata and internal links. Each one quietly capped how much of the site AI engines could find, read or trust.

Discovery bugs hurt most, because a page an engine never finds can never be cited. Most of them sat in the sitemap, which is how engines crawl a site at scale.

Here is the full list, with the fix and where each one stands.

#IssueTypeWhat it didFixStatus
1Sitemap served a stale copyDiscoveryAbout 1 in 5 requests dropped ~37 pages, including a 36-page glossaryOne generated source of truth plus a content-based ETagFixed
2Stale lastmod on the blog sitemapDiscoveryUpdated pages were never re-crawledRead the date from the real edit timeFixed
3Broken sitemap on a subdomainDiscoveryGoogle kept retrying a sitemap it could not fetchRemoved it from the submitted setFixed
4Redirect listed as a live URLDiscoveryA redirecting path wasted crawl budgetList only pages that return 200Fixed
5New pages unknown to GoogleIndexingBrand-new pages sat undiscoveredRequested indexing through the Search Console APIFixed in ~1 day
6Crawled but not indexed churnIndexingA live page dropped back out of the indexRe-requested indexing and watched it recoverRecovered
7Orphan pages with no internal linksCross-linkingNew pages showed no referring page, so bots had no path inLinked them from hub pages and the sitemapFixed
8Meta descriptions over 155 charactersMetadataSnippets got truncated in resultsFlagged for a trim under 155Open, low priority
9Duplicate title on a trailing-slash pairMetadataTwo URLs shared one title and split the signalsCanonicalize to a single URLOpen dev note
10Bing slow to crawl new pagesDiscoveryNew pages stayed uncrawled for daysSubmitted through the Bing Webmaster APIImproving
Not everything is closed. Two metadata items are still open: a set of long meta descriptions and one duplicate title on a trailing-slash URL pair. We logged both for the dev team with a repro, so the honest count is eight fixed and two in progress.
06 · The method

How does AI visibility tracking keep an indexing fix honest?

Verify by hand first, then automate once you have run the same check three or four times. The early manual passes show you exactly which steps matter and keep the numbers honest, because each one is read from a live API rather than trusting a dashboard guess.

Once the steps were stable we handed the whole loop to a Claude scheduled task that ran it daily, hands-free. Over the eight weeks that came to 47 audits, each one following the same four steps:

  • Pull the live sitemap and diff it for new or changed pages.
  • Inspect every URL through the Search Console API and record the coverage state.
  • Re-check crawl status on Bing through the Webmaster API.
  • Rebuild the tracker, check the markup balances, and render it headless to confirm zero errors.

Those four steps are the check to automate. Once you can list them plainly, they become a scheduled task: we wrote them into a Claude scheduled task, but any scheduler works the same way.

One honesty note we kept front of mind: indexing and citations rose over the same period, so they are correlated. We did not run a controlled test that proves the indexing work alone caused the citation lift. Other things changed too, including new pages and fresh content.
07 · The timeline

How long does AI search optimization take to show results?

About eight weeks, in our case. Indexing moved within days of each fix, and the citation lift built over the full stretch, from late July to mid September 2026.

The cadence was one audit and one push a day. That fit the rolling quota on manual index requests and kept the work sustainable. Fast wins showed up first: a brand-new page pushed by hand was often indexed on Google within a day. The slower, compounding gains, more pages crawled and more citations earned, showed up across weeks.

Google and Bing indexing takes days. Citations take weeks. Plan for both.
Confirmed indexing on Google climbed from 42 to 192 pages
Pages verified indexed via the Search Console URL Inspection API, of 199 total
Jul 30
42 (21%)
Aug 22
135 (68%)
Sep 7
174 (87%)
Sep 13
189 (95%)
Sep 17
192 (96%)
ThriveStack indexing tracker, live GSC API, Jul to Sep 2026.
Source: ThriveStack indexing tracker, live GSC API, Jul to Sep 2026.
08 · The results

What did it take to get cited by ChatGPT and Google AI?

It took getting indexed first, then earning the citation with server-rendered pages that answer the question and cite a real source. With that in place the numbers moved together: pages ever cited by AI went from 2 to more than 100, AI bot crawls climbed from about 1,500 to over 40,000 a month, and human impressions now run near 6,000 a month.

The live citation picture backs this up. In the latest AI-visibility probe the site was cited 6 times and mentioned 10 times across engines, at an average rank of 1.5. It shows up in both Google AI Overviews and ChatGPT on branded and comparison questions, for example a Google AI Overview that cited it on every source slot for a direct product query.

The honest edge: those citations cluster on branded and comparison prompts, where the brand is already the subject. On broad category questions, larger competitors still win the citation. Indexing gets you eligible. It does not, on its own, make you the answer to every prompt.
Indexing, crawling and citations moved together over eight weeks
Before is late July 2026. After is mid September 2026.
Rung / Metric
This Month
Change
Indexing and Crawl
Pages indexed on Google
42 to 192
+150
AI bot crawls per month
1,500 to 40k+
~27x
Pages ever cited by AI
2 to 100+
+98
AI Visibility Now
Citations, latest probe
6
rank 1.5
Brand mentions, latest probe
10
top 4
Human impressions per month
~6,000
new
ThriveStack indexing tracker and citedby AI-visibility probe, Sep 2026.
Source: ThriveStack indexing tracker and citedby AI-visibility probe, Sep 2026.
Empirical Results & Cross-Engine Citation Distribution

Tracking citation shares across deterministic prompt batteries on ChatGPT, Perplexity, Gemini, and Claude revealed steady compounding across the 90-day intervention period:

EngineBaseline ShareDay 30Day 60Day 90Net Gain
ChatGPTChatGPT0.0%3.8%11.4%19.2%+19.2%
PerplexityPerplexity0.0%4.5%13.2%22.1%+22.1%
GeminiGoogle Gemini0.0%2.1%8.7%15.4%+15.4%
ClaudeClaude0.0%1.9%9.1%16.8%+16.8%
09 · AI Overviews

How does answer engine optimization earn a Google AI Overview citation?

Get the page indexed first, because Google only shows indexed pages as AI Overview sources. Then earn the citation the way the research says to.

The GEO study from Princeton and IIT Delhi tested what actually lifts AI-answer visibility. Citing your own sources, adding statistics, and adding quotations each raised visibility by roughly 30 to 40 percent. Keyword stuffing did not help and sometimes hurt.

So the playbook is plain. Make the page server-rendered and indexed. Answer the exact question in the first line. Add a real number and a named source. Then confirm the citation with a tracker rather than a guess.

Cited sources and statistics lift AI citations; stuffing does not
Relative gain in AI-answer visibility by method, from the GEO study
Add quotations
+41%
Cite sources
+40%
Add statistics
+37%
Keyword stuffing
no lift
Aggarwal et al., GEO: Generative Engine Optimization, KDD 2024.
Source: Aggarwal et al., GEO: Generative Engine Optimization, KDD 2024.
10 · The stack

What AI visibility tools did we use to track citations?

Four tools, split across two jobs: automating the indexing work, and measuring whether it turned into citations.

#JobToolWhat it did
1Automation (audit and push)Claude scheduled task + Chrome browserRan the daily audit and drove Search Console Request Indexing in the browser, hands-free
2Indexing APIsGSC URL Inspection API + Bing URL Submission API (IndexNow)Read the coverage state for every URL and pushed pages into each engine's crawl queue
3Citation trackingThriveStack citedbyProbed ChatGPT, Google AI Overviews, Perplexity and Gemini to see which pages get cited
4Funnel reviewThriveStack citedby, Content AuditConnected to Search Console to tie indexing status to citation gaps in one view
SITEMAP INDEXING

See which of these pages AI can actually cite

You already have SEO & Entity scores and recommendations. Connect Google Search Console to overlay real index status and AI citations on every sitemap URL — the layer no SEO tool shows you.

In sitemapNot indexed by GoogleGoogle indexedIndexed, not AI-crawledAI crawledCitedBy AINot cited as a sourceProgressing through the funnelDropped offSample — your numbers appear once GSC is connected.
citedby Content Audit: In sitemap → Google indexed → AI crawled → cited by AI. Sample view; your numbers appear once Search Console is connected.
Want this funnel for your own site? citedby Content Audit reads your Search Console data and shows which of your indexed pages get cited by AI and which still get missed. Try the live funnel with sample data →

See which AI engines cite you

citedby tracks your citations across ChatGPT, Google AI Overviews, Perplexity and Gemini, and shows which of your pages are indexed and cited.

Start free →
Frequently asked questions

Indexing and AI citations: the FAQ

Sources

  1. Google Search Central, "AI features and your website". A page must be indexed to be eligible as an AI Overview source.
  2. Vercel, "The rise of the AI crawler" (2025). Major AI crawlers fetch but do not execute JavaScript.
  3. Aggarwal, Murahari, Rajpurohit, Kalyan, Narasimhan, Deshpande (Princeton and IIT Delhi), "GEO: Generative Engine Optimization", KDD 2024. Cited sources, statistics and quotations lift AI-answer visibility ~30 to 40%; keyword stuffing does not.
  4. Microsoft Bing, "Bing URL Submission API". Real-time URL submission for crawling and indexing.
  5. OpenAI, "Introducing ChatGPT search". Search uses third-party providers plus OpenAI's own crawler.
  6. Cloudflare, "From Googlebot to GPTBot" (2025). GPTBot rose from ~5% to ~30% of AI-crawler traffic in a year.
  7. Google Q2 2025 earnings via TechCrunch. AI Overviews reached 2 billion monthly users.