Anthropic · last updated 2026-10-14
Claude
Anthropic's Claude is a conversational AI with web search. Claude searches when it judges the question benefits from it; there is no user toggle documented for that decision. Anthropic documents three crawler roles: ClaudeBot (training only), Claude-SearchBot (search index), and Claude-User (fetches made on a user's behalf).
Grounding model
On-demand web search invoked when the model decides recency or external information is needed. Anthropic separates its crawlers by role: Claude-SearchBot builds the search index, Claude-User fetches pages for user requests, and ClaudeBot gathers training data only. Blocking ClaudeBot does not remove a site from Claude search.
Citation style
Citations with source links and quotes. Anthropic does not document a side panel.
What it rewards
- Long-form, well-structured content the model can ground complex multi-part questions against
- Explicit authorship, dating, and methodology
- Self-contained explanatory writing that survives extraction into a longer-form answer
- Article and Person markup that matches visible content
What it penalizes
- Thin, listicle-heavy content with weak per-item analysis
- Pages with obvious affiliate or sponsored content
- Robots.txt blocking Claude-SearchBot (keeps the page out of the search index; blocking ClaudeBot alone does not)