Consensus Conference 2026: AI Traffic Surpasses Human Traffic! Cloudflare Reveals the Collapse and Rebirth of Internet Business Models

Cloudflare’s Chief Strategy Officer pointed out that AI crawlers are causing the traditional website traffic model to collapse, and non-human traffic has officially surpassed human traffic. The company is promoting the x402 protocol to establish an automated payment mechanism, rebuilding the internet economy.

AI crawler traffic surges, the traditional website traffic model is collapsing

Cloudflare’s Chief Strategy Officer Stephanie Cohen recently stated at the Consensus conference that the global internet is undergoing a fundamental restructuring of business models, and the main reason is not social media, but the rise of AI agents and large language models.

Over the past 20 years, the internet world has been built on a relatively stable exchange mechanism: websites and media provide content for free, search engines and crawlers index the content, then direct real users back to the original sites, while websites monetize through advertising, subscriptions, and e-commerce. But now, AI is rapidly changing this structure. Increasingly, AI systems directly scrape website content, generate summaries, and leave answers in chatbots or AI workflows, so users no longer need to click back to the original site. This means that although content is still heavily used, traffic and revenue are no longer flowing back to content creators.

Cohen stated that currently, in global internet traffic, “non-human traffic” has officially surpassed human traffic, and its growth rate far exceeds that of human users. She revealed that, ten years ago, search crawlers would visit a website about twice to bring back one real visitor; but now, some AI companies’ scraping ratios have deteriorated to “tens of thousands of crawls for only one real user.” This is almost equivalent to the business model being drained for media, forums, knowledge sites, and creators that rely on traffic to survive.

Cloudflare promotes “Paid Internet,” AI data scraping is no longer free

In response to large-scale AI content scraping, Cloudflare’s solution is not to block AI entirely but to allow websites to regain control over traffic.

Cohen pointed out that future websites should have the ability to identify bots, verify their identities, understand their purposes, and decide whether to allow access, limit traffic, or even charge directly.

One of the core technologies is the open payment protocol x402, built on the HTTP 402 “Payment Required” status code. This system, developed jointly by Cloudflare and Coinbase, aims to establish an automated payment mechanism between AI agents and websites.

• Read more: What is the x402 protocol? Behind the x402 meme coin hype, you should understand the future payment revolution

Cohen said that currently, Cloudflare’s network generates over 1 billion HTTP 402 responses daily, which signals that many websites are essentially saying: “If content continues to be used, it needs to be paid for.”

She believes that the biggest problem on the internet has been that AI companies can scrape content at almost zero cost, while content creators receive no revenue. The purpose of x402 is to enable AI agents to automatically pay for content, API usage, and data access costs, just like real users. Currently, the on-chain transaction volume of x402 remains relatively limited, about $28k USD daily, but Cloudflare clearly believes that the true market size is far beyond that, representing a fundamental rebuild of the entire AI internet economy.

The era of AI agent commerce is coming, Visa and Experian begin to lay out

Besides the issue of AI scraping content, Cloudflare is also positioning itself in a larger direction: Agentic Commerce, where AI agents autonomously complete transactions. Cohen mentioned that Cloudflare has already partnered with companies like Visa and Experian to develop the Web Bot Authentication framework, aiming to solve AI agent identity verification issues.

The future scenario might be: AI assistants book flights, purchase goods, manage subscriptions, search research data, and even handle investments and payments for users. But platforms must verify whether these are truly human-authorized AI agents or malicious bots.

Cloudflare believes that the future internet will no longer be dominated by “humans browsing websites,” but by a world where numerous AI agents interact and perform tasks automatically. This also means that payments, identity verification, access control, and data authorization will become the next-generation internet infrastructure. Notably, Cloudflare currently handles over 100 million network requests per second, and if AI agents truly become widespread, its network layer advantage could become a crucial entry point for new AI business models.

The internet economy enters a rebuilding phase, high-quality content is being re-priced

For many media and content industries, the biggest fear brought by AI is “content being eaten up for free by AI.” But Cohen believes this could instead mark the beginning of high-quality content being re-priced. She pointed out that if websites can effectively identify AI traffic and establish payment mechanisms, AI companies will no longer be able to scrape content without limits; instead, they will have to pay for information just like cloud services or API usage. This means the future internet may shift from a “traffic economy” to a “data licensing economy.”

Valuable, original, and credible content may become more expensive and more important in the AI era. From the search engine era, to social media, and now to the AI agent era, the power structure of the internet is being reshuffled. What Cloudflare is trying to do now is not just protect websites but to redefine “who should pay whom between AI and content.”