Cloudflare and beehiiv launch AI Crawl Control for 135,000 newsletter publishers

Beehiiv adds Cloudflare AI Crawl Control so writers can block or allow bots

Beehiiv adds Cloudflare AI Crawl Control so writers can block or allow bots Cloudflare Inc. and newsletter platform beehiiv Inc. today launched an integration that hands independent publishers a single toggle to decide whether artificial intelligence crawlers can reach their work. The integration bakes Cloudflare's AI Crawl Control into the beehiiv dashboard. Writers face a choice. They can open their archives to AI search engines and agents and chase the distribution that brings, or shut AI scraping off and hold their content back for licensing deals later. Beehiiv is turning the option on for its users starting today. Behind the launch is a problem that has gotten worse fast. AI systems now eat up a large and rising share of web traffic and fending them off has meant fiddling with robots.txt files or writing firewall rules. That is work most solo creators were never going to do. Putting the controls in the dashboard takes the code out of it. Flip the controls on and a publisher gets a dashboard, built on Cloudflare's application programming interfaces, that names the AI crawlers knocking on the door. It shows what is getting blocked. It also shows how much referral traffic those crawlers are sending back, the trade-off at the heart of the open-or-block decision. Want to block one model and wave another through? That is a click. Cloudflare says the list keeps itself current as fresh crawlers turn up. The deal is the latest in a year-long campaign. Cloudflare flipped on default AI-scraper blocking for new customers in 2025 and stood up a Pay Per Crawl marketplace where publishers can charge AI firms for access. In January, it bought AI data marketplace startup Human Native Ltd. to flesh out licensed-content tooling for rights holders. Cloudflare has framed the campaign as a fight for content creators "from independent bloggers to the world's largest publishers," in the words of co-founder and Chief Executive Matthew Prince. He called the beehiiv partnership the next step in giving newsletter operators the transparency and control to set their own terms with AI companies, whether they want discovery or want to hold their work back. Tyler Denk, beehiiv's co-founder and CEO, sees the integration as a bargaining chip for writers. AI is changing how readers stumble onto content, he said and creators ought to have a hand on that lever. Some 135,000 publishers run newsletters, websites and podcasts on beehiiv. It takes nothing from their subscription revenue and the audiences stay theirs. For Cloudflare, the integration buys reach into the creator economy and another on-ramp for the Pay Per Crawl model it is wagering will change how AI companies pay for what they take.

Cloudflare partners with beehiiv on AI crawler controls By Investing.com

SAN FRANCISCO - Cloudflare, Inc. (NYSE:NET) and beehiiv announced a partnership to integrate AI crawl control technology into the newsletter publishing platform, according to a press release statement. The $77.2 billion cybersecurity company continues expanding its product offerings despite trading above its InvestingPro Fair Value, placing it among highly valued tech stocks. The integration embeds Cloudflare's Crawl Control technology into beehiiv's platform, allowing newsletter publishers to manage how AI models access their content. Users can choose between two options: allowing AI search engines to crawl their work for broader distribution or blocking AI scraping to protect their content archives. The partnership removes technical requirements previously needed to manage AI bot access, such as manual robots.txt updates or firewall configurations. The integration includes a dashboard showing which AI crawlers are accessing content, one-click permissions to block or allow specific AI models, and automatic updates for new AI crawlers. "Cloudflare is dedicated to protecting and enabling content creators, from independent bloggers to the world's largest publishers," said Matthew Prince, co-founder and CEO of Cloudflare. "This partnership with beehiiv is the next logical step in that mission, giving newsletter operators the transparency and control to navigate the AI era on their own terms."The partnership comes as Cloudflare maintains strong growth momentum with 32% revenue growth and an impressive 73% gross profit margin. According to InvestingPro analysis, which offers detailed insights on over 1,400 US stocks through comprehensive Pro Research Reports, analysts expect the company to turn profitable this year after recent losses. Tyler Denk, co-founder and CEO of beehiiv, stated that the partnership provides creators with tools to "either maximize discovery and distribution, or protect their writing and dictate their own terms." AI Crawl Control will be available to all beehiiv users in beta, with visibility into AI service interactions and traffic generation. beehiiv Max customers will have additional access to block AI crawlers. The features are rolling out today through the platform's dashboard settings. beehiiv operates as a newsletter-first publishing platform with more than 135,000 publishers using the service. In other recent news, Cloudflare Inc. announced a collaboration with major web browsers, including Mozilla Firefox, Google Chrome, and Microsoft Edge, to develop Private Access Control Tokens (PACT). This new protocol is designed to help websites distinguish between human users and automated traffic without relying on invasive tracking methods. Cloudflare also launched its Cloudflare One Design Partner Designation program, offering select partners access to technical resources for deploying its security and network services suite. The program includes global partners such as Arctiq, Consortium, CMT, Presidio, and The Missing Link. On the financial front, Citizens has maintained a Market Outperform rating for Cloudflare, with a price target of $270, following the company's Investor Day. Truist Securities has raised its price target for Cloudflare to $250 from $225, maintaining a Buy rating, citing the company's platform expansion. Meanwhile, Bernstein reiterated a Market Perform rating with a $136 price target, noting Cloudflare's pursuit of opportunities in AI agents amid emerging competition. These developments reflect ongoing interest and analysis from financial firms regarding Cloudflare's growth and strategic initiatives. This article was generated with the support of AI and reviewed by an editor. For more information see our T&C.

Cloudflare, Inc. and beehiiv Announces Strategic Partnership to Integrate AI Crawl Control Technology

Cloudflare, Inc. and beehiiv announced a strategic partnership to redefine the creator economy and how independent creators interact with AI. By integrating Cloudflare?s advanced Crawl Control technology directly into the beehiiv platform, the partnership equips creators with clear visibility and granular control over how AI models use their work. This integration simplifies the process by letting beehiiv users manage their digital footprint through two clear choices: publishers can either opt-in to maximum discovery to allow AI search engines and agents to crawl their work freely for broader distribution, or choose content protection, blocking AI scraping to preserve their archives for future monetization and licensing opportunities. Managing AI bots historically required complex technical engagement, like manual robots.txt updates or firewalls. This partnership removes those technical hurdles, giving publishers of all sizes ? from large media outlets to individual creators ? the ability to easily set automated preferences. Key features of the integration include: Personalized Analytics: Creators get an on-platform dashboard powered by Cloudflare APIs. This shows exactly which AI crawlers are attempting to access their content, which ones are being blocked, and the referral traffic those crawlers send back to the newsletter. One-Click Toggle Permissions: The ability to block or allow specific AI models based on the creator's business goals. Future-Proof Rights Management: Automatic updates that adapt to new AI crawlers as they emerge on the web, ensuring creators have the most up-to-date control without needing to update code. AI Crawl Control will be available to all beehiiv users in beta, giving every publisher visibility into how AI services interact with their content and the traffic they generate. beehiiv Max customers will also have access to AI Crawl Control, enabling them to block AI crawlers and decide how their content is used across the AI ecosystem. The new AI control features are rolling out and will be available through the platform's standard dashboard settings.