
When Cloudflare announced its new Pay-Per-Crawl marketplace, some people saw a breakthrough. The idea is that if AI companies want to crawl your website to train their models, they should compensate you for the use of your content. As the CEO of a legal AI company recently sued for scraping public data, I’d love for this to work.
However, it won’t, at least not in this way.