# AAN Botpass

official crawler IP ranges, polled daily, compiled for the rate limiter

20services

7,082entries

0failing

2026-10-12 11:15last successful fetch

15 6 * * *daily poll (cron)

Combined lists: all.txt sorted_ipv4.txt sorted_ipv6.txt

Service	Category	Entries	Last run	Last good data	Sources polled	Lists
manual Manual Whitelist		21	ok	2026-10-12 11:15	manual-whitelist-ips.txt (project root, edited by hand)	geo raw
google Google Crawlers	AI Bots, Cloud Services, Google Bots, Search Engines	2,179	ok	2026-10-12 11:15	developers.google.com/static/crawling/ipranges/common-crawlers.json developers.google.com/static/crawling/ipranges/special-crawlers.json developers.google.com/static/crawling/ipranges/user-triggered-fetchers.json developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json developers.google.com/static/crawling/ipranges/user-triggered-agents.json	geo raw
bing Bingbot	Search Engines	28	ok	2026-10-12 11:15	www.bing.com/toolbox/bingbot.json	geo raw
duckduckgo DuckDuckBot	AI Bots, Search Engines	486	ok	2026-10-12 11:15	duckduckgo.com/duckduckbot.json	geo raw
apple Applebot	Search Engines	24	ok	2026-10-12 11:15	search.developer.apple.com/applebot.json	geo raw
openai OpenAI Crawlers	AI Bots	287	ok	2026-10-12 11:15	openai.com/gptbot.json openai.com/chatgpt-user.json openai.com/searchbot.json openai.com/adsbot.json	geo raw
anthropic Anthropic ClaudeBot	AI Bots	38	ok	2026-10-12 11:15	claude.com/crawling/bots.json	geo raw
perplexity Perplexity	AI Bots	12	ok	2026-10-12 11:15	www.perplexity.ai/perplexitybot.json www.perplexity.ai/perplexity-user.json	geo raw
meta Meta Crawlers (AS32934)	Social Bots	569	ok	2026-10-12 11:15	stat.ripe.net/data/announced-prefixes/data.json?resource=AS32934	geo raw
amazon Amazon Bots	Cloud Services, Search Engines	3,131	ok	2026-10-12 11:15	developer.amazon.com/amazonbot/ip-addresses/developer.amazon.com/amazonbot/searchbot-ip-addresses/developer.amazon.com/amazonbot/live-ip-addresses/	geo raw
x-twitter Twitterbot (X)	Social Bots	3	ok	2026-10-12 11:15	web.archive.org/web/2024/https://developer.twitter.com/en/docs/twitter-for-websites/cards/guides/troubleshooting-cards	geo raw
pinterest Pinterestbot	Social Bots	1	ok	2026-10-12 11:15	help.pinterest.com/en/business/article/pinterestbot	geo raw
internetarchive Internet Archive (archive.org_bot)	Other Agents	2	ok	2026-10-12 11:15	rdap.arin.net/registry/ip/207.241.224.1 rdap.arin.net/registry/ip/208.70.24.1	geo raw
turnitin TurnitinBot	Other Agents	1	ok	2026-10-12 11:15	www.turnitin.com/robot/crawlerinfo.html	geo raw
ahrefs AhrefsBot	SEO Tools	81	ok	2026-10-12 11:15	api.ahrefs.com/v3/public/crawler-ip-ranges	geo raw
semrush Semrush SiteAuditBot		1	ok	2026-10-12 11:15	www.semrush.com/kb/681-site-audit-troubleshooting	geo raw
mojeek MojeekBot	Search Engines	1	ok	2026-10-12 11:15	www.mojeek.com/mojeekbot.json	geo raw
uptimerobot UptimeRobot		206	ok	2026-10-12 11:15	api.uptimerobot.com/meta/ips	geo raw
youbot YouBot	AI Bots	1	ok	2026-10-12 11:15	you.com/docs/youbot	geo raw
liner LinerBot	AI Bots	10	ok	2026-10-12 11:15	docs.getliner.com/linerbot.json	geo raw

AAN system users 365 ✓ 2026-10-12 07:00

Sorted by importance by default — click a column header to re-sort, click again to flip, third click restores the default order. A failing service keeps serving its last good snapshot until a poll succeeds.

Limited to once per 30 minutes (enforced server-side). CLI is unrestricted: node cli.js poll