Bot Configuration
Choose which of the 84 search, social, AI, SEO and archive crawlers see your rendered pages.
Updated 5/4/2026
Overview
RenderBeam ships with 84 known bot signatures across AI, search, social, SEO, and archive categories. You decide exactly which ones receive pre-rendered HTML.
Presets
Every account starts with four presets you can clone or assign per project:
- Standard — 24 top search and social crawlers. Recommended default for SEO + link previews.
- Minimal — Googlebot, Bingbot, and the four largest social crawlers only. Lowest render volume.
- All — every supported bot turned on, including AI training crawlers.
- Customized — start from any preset and toggle individual bots.
Bot categories
- Search — Googlebot, Bingbot, DuckDuckBot, Yandex, Baidu, etc.
- Social — Facebook, Twitter/X, LinkedIn, Slack, Telegram, Pinterest, Discord.
- AI — GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, Bytespider, and more.
- SEO — Ahrefs, Semrush, Moz, Screaming Frog, Majestic.
- Archive — Internet Archive, Common Crawl.
Per-domain selection
In Bots → your project, pick a preset for that project or switch to a custom selection. Changes take effect on the next bot request — no redeploy needed.
Plan restrictions
| Plan | Available bots |
|---|---|
| Free Trial (30 days) | Standard preset (24 bots), locked, no customization |
| All paid tiers (5K → 1M) | All 84 bots, fully customizable per project |
Trial accounts can preview the full bot list but cannot enable bots outside the Standard preset.
Was this page helpful?