Consensus Conference 2026: AI Traffic Surpasses Human Traffic! Cloudflare Reveals the Collapse and Rebirth of Internet Business Models

Cloudflare’s Chief Strategy Officer pointed out that AI crawlers are causing the traditional website traffic model to collapse, with non-human traffic officially surpassing human traffic. The company is promoting the x402 protocol to establish an automated payment mechanism, rebuilding the internet economy.

AI crawler traffic surges, the traditional website traffic model is collapsing

Cloudflare’s Chief Strategy Officer Stephanie Cohen recently stated at the Consensus conference that the global internet is undergoing a fundamental restructuring of business models, and the main reason is not social media, but the rise of AI agents and large language models.

Over the past 20 years, the online world has been built on a relatively stable exchange mechanism: websites and media provide content for free, search engines and crawlers index it, then direct real users back to the original sites, while websites monetize through ads, subscriptions, and e-commerce. But now, AI is rapidly changing this structure. Increasingly, AI systems directly scrape website content, generate summaries, and leave answers in chatbots or AI workflows, so users no longer need to click back to the original site. This means that although content is still heavily used, traffic and revenue are no longer flowing back to content creators.

Cohen stated that currently, non-human traffic has officially surpassed human traffic in global internet traffic, and its growth rate far exceeds that of human users. She revealed that, ten years ago, search crawlers would visit a website about twice to bring back one real visitor; but now, some AI companies’ scraping ratios have deteriorated to “tens of thousands of crawls for only one real user.” For media, forums, knowledge sites, and creators relying on traffic for survival, this is almost equivalent to their business models being hollowed out.

Cloudflare promotes a “Paid Internet,” where AI data scraping is no longer free

Faced with large-scale AI content scraping, Cloudflare’s solution is not to block AI entirely but to let websites regain control over traffic.

Cohen pointed out that future websites should have the ability to identify bots, verify their identities, understand their purposes, and decide whether to allow access, limit traffic, or even charge directly.

One of the core technologies is the open payment protocol x402, built on the HTTP 402 “Payment Required” status code. This system, developed jointly by Cloudflare and Coinbase, aims to establish an automated payment mechanism between AI agents and websites.

• Read more: What is the x402 protocol? Behind the x402 meme coin hype, you should understand the future payment revolution

Cohen said that currently, Cloudflare’s network generates over 1 billion HTTP 402 responses daily, which signals that many websites are essentially saying: “If content continues to be used, it needs to be paid for.”

She believes that the biggest problem with the internet in the past was that AI companies could scrape content at almost zero cost, while content creators received no revenue. The purpose of x402 is to enable AI agents to automatically pay for content, API usage, and data access costs, just like real users. Currently, the on-chain transaction volume for x402 remains relatively limited, about $28k USD daily, but Cloudflare clearly believes the true market size is far beyond that, representing a foundational rebuild of the entire AI internet economy.

The era of AI agent commerce is coming, Visa and Experian begin to lay out

In addition to the issue of AI scraping content, Cloudflare is also positioning itself in a broader direction: Agentic Commerce, where AI agents autonomously complete transactions. Cohen mentioned that Cloudflare is currently collaborating with companies like Visa and Experian to develop the Web Bot Authentication framework, aiming to solve AI agent identity verification issues.

The future scenario might be: AI assistants book flights, purchase goods, manage subscriptions, search research data, and even handle investments and payments for users. But platforms must verify whether these are truly authorized AI agents or malicious bots.

Cloudflare believes that the future internet will no longer be dominated by “humans browsing websites,” but by a world where numerous AI agents interact and perform tasks automatically. This also means that payments, identity verification, access control, and data authorization will become the next-generation internet infrastructure. Notably, Cloudflare currently handles over 100 million network requests per second, and if AI agents become truly widespread, its network layer advantage could become a key entry point for new AI business models.

The internet economy enters a rebuilding phase, high-quality content is being re-priced

For many media and content industries, the biggest fear brought by AI is that “content will be eaten up for free by AI.” But Cohen believes this could instead mark the beginning of high-quality content being re-priced. She pointed out that if websites can effectively identify AI traffic and establish payment mechanisms, AI companies will no longer be able to scrape content without limits; instead, they will need to pay for information just like cloud services or APIs. This suggests that the future internet may shift from a “traffic economy” to a “data licensing economy.”

Valuable, original, and credible content may become more expensive and more important in the AI era. From the search engine era, to social media, and now to the AI agent era, the power structure of the internet is being reshuffled. What Cloudflare is trying to do now is not just protect websites but to redefine “who should pay whom” between AI and content.