TollBit – Monetize your content
🤖 2025, June 11, TollBit State of the Bots report reveals significant trends in AI scraping. RAG bot scrapes surged by 49% from Q4 to Q1. Websites with pre-2025 Analytics saw traffic nearly double, up by 87% in Q1. March saw over 26 million scrapes bypassing robots.txt, with non-compliance rising from 3.3% to 12.9%. Bot Paywall traffic soared by 732% from Q4 2024 to Q1 2025, indicating a shift in publisher defenses.
Share