Amazonbot is finally respecting robots.txt

xeiaso.net
May 14, 2026
1 min read
🔥🔥🔥🔥🔥
56/100
Summary
Amazonbot is finally respecting robots.txt Published on , 239 words, 1 minutes to read Thanks for giving me a viable business model Amazon! I just got an email from Amazon saying they're finally going to respect robots.txt. Here's the verbatim email I got: We are writing to inform you that starting Monday, June 15, 2026, crawl preferences for Amazonbot will be managed solely through the industry-s...
Coverage & discussions
Hacker News · xeiaso.net
Community discussions
Hacker News discussion ↗
Historical count: 5 · 5 saved in sample · Historical sample
Awaiting analysis