I4UDeutsch
← Back to the top 50
No. 15 of the most-visited websites in Germany · As of November 15, 2026

Can ChatGPT, Claude and Gemini read DER SPIEGEL?

Every morning, we open the spiegel.de homepage with the same fetch tools ChatGPT, Claude and Gemini use. This page shows which AI can read it, which gets turned away and why.

The short answer

ChatGPT cannot read spiegel.de: the website’s robots.txt blocks ChatGPT-User from the homepage. Claude cannot read spiegel.de: the website’s robots.txt blocks Claude-User from the homepage. Gemini uses spiegel.de as a source, but through Google Search. Google’s own fetch tool rejected the homepage. Meta AI: robots.txt allows Meta’s fetcher. We can’t test it, because Meta offers no public fetch tool.

Result per AI

ChatGPTrobots.txt blocks
Clauderobots.txt blocks
Geminireads the page
Meta AI*robots.txt allows

What spiegel.de’s robots.txt says

User-agent: *
Allow: /
Disallow: /*CR-Dokumentation.pdf$

User-agent: OAI-SearchBot
Allow: /ausland/
Allow: /partnerschaft/
Allow: /gesundheit/
Allow: /familie/
Allow: /reise/
Allow: /psychologie/
Allow: /stil/
Allow: /tests/
Disallow: /

User-agent: ChatGPT-User
Allow: /ausland/
Allow: /partnerschaft/
Allow: /gesundheit/
Allow: /familie/
Allow: /reise/
Allow: /psychologie/
Allow: /stil/
Allow: /tests/
Disallow: /

User-agent: Claude-SearchBot
Allow: /ausland/
Allow: /partnerschaft/
Allow: /gesundheit/
Allow: /familie/
Allow: /reise/
Allow: /psychologie/
Allow: /stil/
Allow: /tests/
Disallow: /

User-agent: Claude-User
Allow: /ausland/
Allow: /partnerschaft/
Allow: /gesundheit/
Allow: /familie/
Allow: /reise/
Allow: /psychologie/
Allow: /stil/
Allow: /tests/
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Meta-ExternalAgent
Disallow: /

Excerpt showing only the rules for AI agents and for all bots (*). robots.txt is a request from the website, not a technical lock. Anthropic says its bots honor it; for the ChatGPT-User fetcher, OpenAI says the rules may not apply.

Bot protection

When we loaded it in a regular Chrome browser, spiegel.de showed no bot protection.

Changes

Nothing has changed for spiegel.de since daily checks began on November 14, 2026.

Frequently asked questions about DER SPIEGEL

Can ChatGPT read spiegel.de?

No. ChatGPT cannot read spiegel.de: the website’s robots.txt blocks ChatGPT-User from the homepage. (As of November 15, 2026)

Can Claude read spiegel.de?

No. Claude cannot read spiegel.de: the website’s robots.txt blocks Claude-User from the homepage. (As of November 15, 2026)

Can Gemini read spiegel.de?

Yes. Gemini uses spiegel.de as a source, but through Google Search. Google’s own fetch tool rejected the homepage. (As of November 15, 2026)

Does DER SPIEGEL block AI crawlers in robots.txt?

Yes. Its robots.txt blocks ChatGPT-User, OAI-SearchBot, GPTBot, Claude-User, Claude-SearchBot, ClaudeBot, meta-externalagent.

Badge for spiegel.de

The badge shows the latest check and updates daily.

spiegel.despiegel.de

<a href="https://i4u.business/en/ki-agent-radar/spiegel-de/"><img src="https://i4u.business/en/ki-agent-radar/badge/spiegel.de-light.svg" alt="AI Agent Radar: which AI agents can read spiegel.de" height="42"></a>

Check another website

How to cite this data

Source: i4u AI Agent Radar, i4u.business/en/ki-agent-radar/spiegel-de/

Data as of: November 15, 2026 · Licence: CC BY 4.0, credit “i4u” with a link. · Press and questions: info@i4u.business

Download the data: CSV, Top 50 · JSON, Top 50