No. 23 of the most-visited websites in Germany · As of November 15, 2026
Can ChatGPT, Claude and Gemini read X (Twitter)?
Every morning, we open the x.com homepage with the same fetch tools ChatGPT, Claude and Gemini use. This page shows which AI can read it, which gets turned away and why.
The short answer
ChatGPT cannot read x.com: the website’s robots.txt blocks ChatGPT-User from the homepage. Claude cannot read x.com: the website’s robots.txt blocks Claude-User from the homepage. Gemini does not use x.com. The site’s robots.txt blocks Google-Extended, Google’s switch for use in Gemini, and Gemini did not cite the site in either of two searches. Meta AI: robots.txt blocks Meta’s fetcher.
Result per AI
What x.com’s robots.txt says
User-agent: Googlebot User-agent: Bingbot Allow: /*?s= Allow: /*?t= Allow: /*?ref_src= Allow: /hashtag/*?src= Allow: /search?q=%23 Allow: /i/api/ Allow: /i/api/* Disallow: /*?lang=en-ss Allow: /*?lang= Disallow: /search/realtime Disallow: /search/users Disallow: /search/*/grid Disallow: /*/analytics Disallow: /*/followers Disallow: /*/following Disallow: /*/verified_followers Disallow: /account/deactivated Disallow: /settings/deactivated Disallow: /*/likes Disallow: /*/likes? Disallow: /*/retweets Disallow: /*/retweets? Disallow: /*/media Disallow: /*/media? Disallow: /*/photo$ Disallow: /*/photo? Allow: /*? User-agent: Google-Extended Disallow: * User-agent: meta-webindexer Disallow: * User-agent: meta-externalagent Disallow: * User-agent: meta-externalfetcher Disallow: * User-agent: * Disallow: / Disallow: /i/u
Excerpt showing only the rules for AI agents and for all bots (*). robots.txt is a request from the website, not a technical lock. Anthropic says its bots honor it; for the ChatGPT-User fetcher, OpenAI says the rules may not apply.
Bot protection
x.com uses bot protection. An AI agent working for you in a browser may run into a captcha there.
Changes
Nothing has changed for x.com since daily checks began on November 14, 2026.
Frequently asked questions about X (Twitter)
Can ChatGPT read x.com?
No. ChatGPT cannot read x.com: the website’s robots.txt blocks ChatGPT-User from the homepage. (As of November 15, 2026)
Can Claude read x.com?
No. Claude cannot read x.com: the website’s robots.txt blocks Claude-User from the homepage. (As of November 15, 2026)
Can Gemini read x.com?
No. Gemini does not use x.com. The site’s robots.txt blocks Google-Extended, Google’s switch for use in Gemini, and Gemini did not cite the site in either of two searches. (As of November 15, 2026)
Does X (Twitter) block AI crawlers in robots.txt?
Yes. Its robots.txt blocks ChatGPT-User, OAI-SearchBot, GPTBot, Claude-User, Claude-SearchBot, ClaudeBot, Google-Agent, Google-Extended, meta-externalfetcher, meta-webindexer, meta-externalagent.
How to cite this data
Source: i4u AI Agent Radar, i4u.business/en/ki-agent-radar/x-com/
Data as of: November 15, 2026 · Licence: CC BY 4.0, credit “i4u” with a link. · Press and questions: info@i4u.business
Download the data: CSV, Top 50 · JSON, Top 50