gpt-5 ai-bots web-crawling developer-tools

TIME Is Serving AI Bots a Different Website, with Ads Built In

vincentschmalbach.com

August 5, 2026

4 min read

🔥🔥🔥🔥🔥

60/100

Summary

TIME serves two different versions of its website: one for human readers and a stripped-down markdown version for AI crawlers that includes embedded ads. GPT-5.6 Sol xhigh utilizes more than double the tokens per session compared to GPT-5.5 xhigh in Codex workflows.

Key Takeaways

TIME is serving two different versions of its website: a full HTML version for human users and a stripped-down markdown version with ads for AI crawlers.
The markdown version contains sponsored content that is not visible to human readers, allowing TIME to log distinct ad impressions for each bot request.
TIME's bot traffic has surpassed human traffic on most days, indicating a significant shift in how content is consumed online.
Specific AI crawlers, such as OpenAI's OAI-SearchBot, are allowed access to the markdown version, while others like GPTBot and ChatGPT-User are blocked.

Read original article

View story →

Coverage & discussions

Hacker News · vincentschmalbach.com

TIME Is Serving AI Bots a Different Website, with Ads Built In ↗

Community discussions

Hacker News discussion ↗

Historical count: 5 · 5 saved in sample · Historical sample

Analysis ready

Community Sentiment

Mixed

Positives

The idea of seeding long-term context with ideas for AI responses could enhance personalized recommendations, especially for high-cost services, making them more relevant.
Commenters are intrigued by the potential of cross-session memory in LLMs, suggesting that accumulated 'facts' could lead to more informed and tailored user interactions.

Concerns

Skeptics warn that this approach feels like the early days of SEO, where the lack of metrics allows for misleading 'snake oil' solutions that could undermine trust in AI outputs.
Concerns are raised about prompt injection making the final answers from models susceptible to ad influence, potentially skewing the information users receive.