AI Crawler Directory

Claude-User Anthropic's user-triggered fetcher

Claude-User fetches individual web pages on demand when a Claude user asks about a URL or Claude needs a live page to answer. Each request represents a real person consuming your content through Claude — the Anthropic counterpart to ChatGPT-User.

User-triggered fetcherReviewed August 2026
Quick facts
Operator
Anthropic
Feeds
Live page fetches when Claude users ask about a URL
Type
User-triggered fetcher
robots.txt token
Claude-User
Respects robots.txt
Yes

What is Claude-User?

Traffic is query-driven and page-specific rather than site-wide: single fetches at the moment of a user request, with volume tracking how often your pages come up in Claude conversations.

Like other server-side fetchers it never executes your analytics JavaScript, so this readership is invisible in GA4 and appears only in server or CDN logs.

How to identify Claude-User

Claude-User identifies itself with the following user-agent string:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-User/1.0; +https://www.anthropic.com)

Never trust the user-agent string alone. Scrapers routinely impersonate well-known crawlers to inherit their access. Documented by Anthropic alongside its other bots; verify unexpected volumes against DNS and Anthropic's published guidance.

Note that most AI crawlers and fetchers, Claude-User included, do not execute JavaScript — so this traffic is invisible to GA4 and every script-based analytics tool. Server logs, CDN analytics, or a dedicated bot-analytics layer are the only places you will see it. For the full picture of measuring AI-driven visits, see our guide on how to track AI traffic.

Controlling Claude-User with robots.txt

To refuse Claude-User access to your entire site, add this to your robots.txt:

User-agent: Claude-User
Disallow: /

To restrict it from specific sections only (for example, premium content) while leaving the rest open:

User-agent: Claude-User
Disallow: /premium/
Disallow: /members/

Should you block or monetize Claude-User?

The case for blocking: Blocking prevents Claude from reading your pages even on explicit user request — the right call only for hard-paywalled content you don't want summarized on demand.

The case for allowing or monetizing: On-demand agent fetches for a human reader are the canonical monetizable agent visit: per-fetch licensing or sponsored context can price the consumption that used to be a pageview.

Bottom line
Allow it for open content; block or license it for paywalled content. Silent absence from conversations where users explicitly requested you is rarely a win.
Where Oasy fits

See exactly what Claude-User does on your site — then decide what that access is worth.

Oasy detects and fingerprints 50+ AI crawlers with per-URL analytics, blocks the ones you exclude at the edge, and turns the rest into revenue — licensed RAG access and sponsored placement inside AI answers, settled weekly. Analytics scripts can't see this traffic; your server logs can, and so can we.

Join the waitlist

Frequently asked questions

Why is Claude-User fetching pages that aren't indexed anywhere?+

Users paste URLs directly into Claude. Any page a user references can be fetched on demand, independent of any crawl or index.

Do Claude-User visits appear in my analytics?+

Not in JavaScript-based analytics like GA4 — the fetch happens server-side without running your tags. You need server logs, CDN analytics, or a bot-traffic layer to see them.

Stay informed on life in Europe as an expat. The Local delivers daily news, guides and essential info across 9 European countries. Sign up for the free newsletter at thelocal.com/free-newsletter