🤖 Known Bots IP Whitelist

This repository contains up-to-date lists of IP addresses of known bots and crawlers, useful for whitelisting or filtering network traffic. They can also be used as blacklists.

Do you have any questions or want to receive notifications about important changes or new features in my repositories? Join my Discord server! If you don't use Discord, you can also open an issue on GitHub.

The project is released under the MIT license - you can do whatever you want with it.
If you like this repository, leave a star ⭐. Thank you!

🔄 Update frequency	📋 Changelog
Every 6 hours	CHANGELOG.md

📘 Combined IP Lists

🔀 All (12,059 IPs, 5,716 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.csv

🤖 Crawlers only (10,391 IPs, 3,837 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.csv

🧠 AI only (0 IPs, 325 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.csv

📡 Monitoring only (638 IPs, 91 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.csv

🏗️ Infrastructure only (999 IPs, 1,451 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.csv

💳 Payments only (31 IPs, 12 CIDRs)

Format	URL
TXT	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-payments-ips.txt
JSON	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-payments-ips.json
CSV	raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-payments-ips.csv

🌍 Supported Services

🤖 Crawlers (10,391 IPs, 3,837 CIDRs)

Search engines, SEO tools and web testing bots.

Service	IPs & CIDRs	Sources	Downloads
GoogleBot	0 - 317	developers.google.com	TXT • CSV • JSON
Google Special Crawlers	0 - 272	developers.google.com	TXT • CSV • JSON
Google User-Triggered Fetchers	0 - 1,592	Fetchers & Google	TXT • CSV • JSON
BingBot	0 - 29	www.bing.com	TXT • CSV • JSON
DuckDuckBot	0 - 486	duckduckgo.com	TXT • CSV • JSON
YandexBot	0 - 16	yandex.com	TXT • CSV • JSON
FacebookBot	0 - 1,096	RIPEstat & RADB	TXT • CSV • JSON
Applebot	0 - 24	search.developer.apple.com	TXT • CSV • JSON
Kagi	4 - 0	Custom list	TXT • CSV • JSON
AhrefsBot	10,350 - 0	api.ahrefs.com	TXT • CSV • JSON
Semrush	0 - 5	RIPEstat & RADB	TXT • CSV • JSON
WebPageTest Bot	37 - 0	www.webpagetest.org	TXT • CSV • JSON

🧠 AI (0 IPs, 325 CIDRs)

AI crawlers from large language model providers.

Service	IPs & CIDRs	Sources	Downloads
ClaudeBot	0 - 14	claude.com	TXT • CSV • JSON
GPTBot	0 - 18	openai.com	TXT • CSV • JSON
OpenAI SearchBot	0 - 39	openai.com	TXT • CSV • JSON
ChatGPT User	0 - 237	openai.com	TXT • CSV • JSON
PerplexityBot	0 - 13	perplexity.ai	TXT • CSV • JSON
Perplexity User	0 - 10	perplexity.ai	TXT • CSV • JSON

📡 Monitoring (638 IPs, 91 CIDRs)

Uptime monitoring services and internet scanners.

Service	IPs & CIDRs	Sources	Downloads
BetterStack	50 - 0	uptime.betterstack.com	TXT • CSV • JSON
PingdomBot	210 - 0	IPv4 & IPv6	TXT • CSV • JSON
Pulsetic	81 - 6	IPv4 & IPv6	TXT • CSV • JSON
UptimeRobot	206 - 0	uptimerobot.com	TXT • CSV • JSON
Censys	0 - 42	RIPEstat & RADB	TXT • CSV • JSON
Modat Scanner	0 - 37	scanner.modat.io	TXT • CSV • JSON
Shodan	95 - 6	Custom list	TXT • CSV • JSON

🏗️ Infrastructure (999 IPs, 1,451 CIDRs)

CDN providers, hosting networks, DNS resolvers and web services.

Service	IPs & CIDRs	Sources	Downloads
Cloudflare	0 - 22	IPv4 & IPv6	TXT • CSV • JSON
Bunny CDN	926 - 0	IPv4 & IPv6	TXT • CSV • JSON
Canonical	0 - 44	RIPEstat & RADB	TXT • CSV • JSON
NASK PL	0 - 645	RIPEstat & RADB	TXT • CSV • JSON
Palo Alto Networks	0 - 94	RIPEstat, RADB & Custom list	TXT • CSV • JSON
DNS Resolvers	72 - 0	Custom list	TXT • CSV • JSON
TelegramBot	0 - 14	core.telegram.org	TXT • CSV • JSON
RSS API	1 - 1	rssapi.net	TXT • CSV • JSON
Baidu	0 - 631	RIPEstat & RADB	TXT • CSV • JSON

💳 Payments (31 IPs, 12 CIDRs)

Payment gateway webhook and notification servers (live & sandbox).

Service	IPs & CIDRs	Sources	Downloads
Stripe	15 - 0	stripe.com	TXT • CSV • JSON
PayPal	0 - 8	paypal.com	TXT • CSV • JSON
Paddle	0 - 12	Live & Sandbox	TXT • CSV • JSON
Square	4 - 0	Custom list	TXT • CSV • JSON
PayU	12 - 0	Custom list	TXT • CSV • JSON