No. 15 of the most-visited websites in Germany · As of November 15, 2026
Can ChatGPT, Claude and Gemini read DER SPIEGEL?
Every morning, we open the spiegel.de homepage with the same fetch tools ChatGPT, Claude and Gemini use. This page shows which AI can read it, which gets turned away and why.
The short answer
ChatGPT cannot read spiegel.de: the website’s robots.txt blocks ChatGPT-User from the homepage. Claude cannot read spiegel.de: the website’s robots.txt blocks Claude-User from the homepage. Gemini uses spiegel.de as a source, but through Google Search. Google’s own fetch tool rejected the homepage. Meta AI: robots.txt allows Meta’s fetcher. We can’t test it, because Meta offers no public fetch tool.
Result per AI
What spiegel.de’s robots.txt says
User-agent: * Allow: / Disallow: /*CR-Dokumentation.pdf$ User-agent: OAI-SearchBot Allow: /ausland/ Allow: /partnerschaft/ Allow: /gesundheit/ Allow: /familie/ Allow: /reise/ Allow: /psychologie/ Allow: /stil/ Allow: /tests/ Disallow: / User-agent: ChatGPT-User Allow: /ausland/ Allow: /partnerschaft/ Allow: /gesundheit/ Allow: /familie/ Allow: /reise/ Allow: /psychologie/ Allow: /stil/ Allow: /tests/ Disallow: / User-agent: Claude-SearchBot Allow: /ausland/ Allow: /partnerschaft/ Allow: /gesundheit/ Allow: /familie/ Allow: /reise/ Allow: /psychologie/ Allow: /stil/ Allow: /tests/ Disallow: / User-agent: Claude-User Allow: /ausland/ Allow: /partnerschaft/ Allow: /gesundheit/ Allow: /familie/ Allow: /reise/ Allow: /psychologie/ Allow: /stil/ Allow: /tests/ Disallow: / User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Meta-ExternalAgent Disallow: /
Excerpt showing only the rules for AI agents and for all bots (*). robots.txt is a request from the website, not a technical lock. Anthropic says its bots honor it; for the ChatGPT-User fetcher, OpenAI says the rules may not apply.
Bot protection
When we loaded it in a regular Chrome browser, spiegel.de showed no bot protection.
Changes
Nothing has changed for spiegel.de since daily checks began on November 14, 2026.
Frequently asked questions about DER SPIEGEL
Can ChatGPT read spiegel.de?
No. ChatGPT cannot read spiegel.de: the website’s robots.txt blocks ChatGPT-User from the homepage. (As of November 15, 2026)
Can Claude read spiegel.de?
No. Claude cannot read spiegel.de: the website’s robots.txt blocks Claude-User from the homepage. (As of November 15, 2026)
Can Gemini read spiegel.de?
Yes. Gemini uses spiegel.de as a source, but through Google Search. Google’s own fetch tool rejected the homepage. (As of November 15, 2026)
Does DER SPIEGEL block AI crawlers in robots.txt?
Yes. Its robots.txt blocks ChatGPT-User, OAI-SearchBot, GPTBot, Claude-User, Claude-SearchBot, ClaudeBot, meta-externalagent.
How to cite this data
Source: i4u AI Agent Radar, i4u.business/en/ki-agent-radar/spiegel-de/
Data as of: November 15, 2026 · Licence: CC BY 4.0, credit “i4u” with a link. · Press and questions: info@i4u.business
Download the data: CSV, Top 50 · JSON, Top 50