Joint White Paper Plots Sustainable Path for AI, Cloudflare, and the Future of Independent Journalism
Open Markets Welcomes the Launch of the Washington Monthly Institute with This First Joint White Paper
The Center for Journalism and Liberty (CJL) at the Open Markets Institute today welcomed the launch of the Washington Monthly Institute with the release of a joint white paper, “AI and the Future of Independent Journalism: The Promise and Peril of Privately Controlled Data Markets for Media Content.”
Written by CJL Director Dr. Courtney Radsch, the report examines how artificial intelligence is accelerating a long-running power imbalance between technology platforms and journalism—one that first took shape as digital advertising markets shifted revenue away from publishers and toward dominant tech firms. AI now intensifies this dynamic by relying on journalistic content for training while simultaneously reducing traffic and compensation to original reporting, placing pressure on small, local, and independent news organizations that lack bargaining power or legal resources.
A central focus of the report is the growing role of infrastructure providers, especially Cloudflare, in shaping the emerging rules of AI-driven data access. Cloudflare now enables publishers to distinguish between types of web crawlers, block AI training bots, and allow search indexing under its Content Signals Policy. It has also introduced cryptographic bot verification and a pilot pay-per-crawl marketplace that allows publishers to charge AI companies for content use.
These tools represent a potential turning point: for the first time, publishers may have technical mechanisms to enforce consent and receive compensation when their work is used in AI systems. At the same time, the report warns that without public oversight, such systems risk concentrating significant gatekeeping power in a small number of infrastructure providers, effectively creating new chokepoints for access to journalism and replicating the extractive dynamics of the digital advertising era in a new form.
The report concludes that the future of independent journalism in the AI era will depend on whether these emerging technologies are governed by strong public-interest rules. Technology alone, it argues, cannot resolve the imbalance between publishers and platforms; it must be paired with enforceable policy designed to ensure competition, transparency, and fair compensation.
Accordingly, the white paper recommends the following policy actions:
Strengthen antitrust enforcement in AI markets to prevent excessive concentration among dominant buyers of journalistic content.
Ban discriminatory or opaque access systems and ensure due process protections for data access, licensing, and pay-per-crawl markets.
Mandate transparency and auditability for AI companies and infrastructure providers regarding web crawling, data use, and content monetization.
Prevent gatekeeping in AI content marketplaces by limiting the ability of infrastructure providers to control pricing or access to journalistic content.
Develop open, interoperable technical standards for content licensing and machine-readable consent signals across platforms.
Support rights-based licensing frameworks that enable collective bargaining and reduce dependence on private intermediaries.
Ensure accountability for automated systems that access, process, or generate journalistic content, including disclosure and audit requirements.
Together, the report argues that these measures are necessary to ensure that AI strengthens rather than further weakens the economic foundations of independent journalism.
Also see: Landmark New Report Warns That A Flawed AI Content Market is Accelerating ‘Content Cannibalization,’ by Dr. Courtney Radsch and Karina Montoya (April 2026)
###