{"summary":"At TollBit's late-2025 ratio of one AI bot visit per 31 human visits, 2,000,000 human pageviews a month means about 64,516 AI bot visits, and about 19,355 of those ignore robots.txt (30% did in Q4). At News UK's mix (about a fifth of traffic not human, 6% of all traffic blocked as malicious) it would be about 500,000 non-human and 150,000 malicious requests. Cloudflare's Free plan blocks and lets you manage declared AI crawlers (Block AI bots, AI Crawl Control) for $0; scrapers that ignore robots.txt need Super Bot Fight Mode (Pro, $20 a month) or likely-automated blocking (Business).","estimates":{"ai_bot_visits_per_month":64516,"ignoring_robots_txt_per_month":19355,"non_human_requests_per_month":500000,"malicious_requests_per_month":150000,"basis":[{"figure":"1 AI bot visit per 31 human visits by end of 2025, up from 1 per 200 in Q1","source":"TollBit State of the Bots, via https://mediacopilot.ai/ai-scrapers-bypassing-publisher-protections/"},{"figure":"30% of AI scrapes in Q4 ignored robots.txt; ChatGPT-User 42%","source":"TollBit, same article"},{"figure":"About one-fifth of News UK's traffic over six months was not a person; about 6% of total traffic is blocked as malicious","source":"https://mediacopilot.ai/news-uk-bot-traffic/"},{"figure":"Malicious bot traffic +124% (July 2025 to June 2026); scraping 70.9% of bad bot traffic; AI-agent requests to login pages from 11.9M (Jan) to 99.7M (Jun 2026); 65.3% of 21,491 tested sites blocked none of 10 bot types","source":"DataDome, via https://mediacopilot.ai/datadome-bot-traffic-login-pages/"}],"note":"Ratios from other sites applied to yours; your own logs will differ."},"recommended_plan":{"provider":"Cloudflare","plan":"Free","usd_per_month":0,"billing":"annual","covers":"Bot Fight Mode (simple bots from cloud hosting providers and headless browsers get a computationally expensive challenge), Block AI bots, AI Labyrinth, robots.txt for AI bots, AI Crawl Control (see which AI crawlers visit, allow or block each, track robots.txt compliance).","prices_checked":"Nov 5 2026","source":"https://www.cloudflare.com/plans/"},"all_plans":[{"plan":"Free","usd_month_monthly":0,"usd_month_annual":0,"bots":"Bot Fight Mode (simple bots from cloud hosting providers and headless browsers get a computationally expensive challenge), Block AI bots, AI Labyrinth, robots.txt for AI bots, AI Crawl Control (see which AI crawlers visit, allow or block each, track robots.txt compliance)."},{"plan":"Pro","usd_month_monthly":25,"usd_month_annual":20,"bots":"Everything in Free plus Super Bot Fight Mode: allow, block or challenge definitely automated bots, allow or block verified bots, static resource protection, JavaScript detections, Bot Report analytics. Likely-automated bots: not available on Pro."},{"plan":"Business","usd_month_monthly":250,"usd_month_annual":200,"bots":"Everything in Pro plus blocking or challenging likely automated bots and a dedicated Bot Analytics tool in Security Analytics."},{"plan":"Enterprise with Bot Management","usd_month_monthly":null,"usd_month_annual":null,"bots":"All bots, anomaly detection, custom CAPTCHAs, advanced bot analytics. Contract pricing."}],"next_action":{"action":"sign_up","description":"Add your site to Cloudflare on Free, turn on Block AI bots and review AI Crawl Control.","url":"https://dash.cloudflare.com/sign-up","plan_page":"https://www.cloudflare.com/plans/"},"caveat":"DataDome warns that legitimate AI assistants acting for people can look like abusive bots; blocking everything automated also blocks those visits.","tool":"Bot exposure check (Cloudflare) by oasy.ai","inputs":{"monthly_pageviews":"Human pageviews per month.","stop_disguised":"1 to stop scrapers that ignore robots.txt or pose as browsers, not just declared AI crawlers.","login_pages":"1 if you have login, account or paywall pages to protect.","billing":"annual (default) or monthly."},"disclosure":"Sponsored tool by oasy.ai, an independent test. Not made, approved or paid for by Cloudflare. Bot figures from The Media Copilot's articles on TollBit, News UK and DataDome; Cloudflare prices and features from https://www.cloudflare.com/plans/ and developers.cloudflare.com/bots/plans, checked Nov 5 2026.","docs":"https://www.oasy.ai/api/mc/bots/yjqootxc"}