Bot health

Bot crawl health

Per-bot hit matrix, stale-citation recovery queue, error hygiene.

Every AI user-agent's activity, joined to the URLs they hit. Heatmap rows = URLs, columns = bots, cell = days-since-last-hit. Emerging crawler detection on fresh UAs.

For:In-house brandEnterpriseAgency activator
app.peecockpit.pro/bots
Pages crawled 7d
1,284
all AI bots
Stalest bot
PerplexityBot
18d avg
New UAs
3
this week
4xx/5xx to AI
7
across 4 URLs
PerplexityBot · 18d avg
stale on /pricing, /docs/api, /blog/release-notes
Pages crawled 7d
1,284
all AI bots
Stalest bot
PerplexityBot
18d avg
New UAs
3
this week
4xx/5xx to AI
7
across 4 URLs
What it does

Why this surface exists.

Workflow

The chain that runs behind the page.

4-step composite. Every tool call is logged for the tracked_id audit.

1
Ingest logs

Three interchangeable adapters: Cloudflare Logpush → R2 → D1 (production), BotsAnalyser API (api.botsanalyser.com) for teams without log access, and a static-JSON access-log driver for the Grandia demo.

Cloudflare LogpushBotsAnalyser APIR2 · D1
2
Classify user-agents

28 regex rules cover OpenAI / Anthropic / Perplexity / Google-Extended / Bing / Apple / Meta / Amazon / Bytespider / Mistral / Cohere / CCBot / Diffbot / DuckAssist / You / Phind / Kagi / Yandex / Baidu.

BOT_RULES classifier
3
Build the heatmap

Rows = URLs, columns = bots, cell = days-since-last-hit, coloured by stale threshold per model.

Aggregation job
4
Fire recovery queue

Pages exceeding their model-specific staleness threshold feed the action queue with a recrawl chain.

Action queueSitemap ping · internal-link boost · re-crawl request
Datasources used

Where the numbers come from.

Each datasource has a provenance chip on the live dashboard, so you always know whether a number came from a live MCP call, a cached snapshot, or a fallback.

Server access logs
Crawl
Crawl

AI bot crawl activity (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, Google-Extended).

Per-bot last-hit timestampHits per URL per dayNon-200 errors for AI user-agentsEmerging crawler detection
Peec AI MCP
Citation
Citation

Citations, share of voice, sentiment, search-query fan-out, prompt suggestions.

Brand mentions per model · per clusterShare of voice deltasCited URLs + url_classificationsearch_queries fan-out
Related

Where this connects.

Join the early-access list

You'll get an invite when we open the next batch, plus one short email when we ship a new feature page. No drip campaign, no spam.