{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreibbybhkh7t6sibimecnntwgev5g7x72qhg6mw4p5czrkkc6invu7y",
    "uri": "at://did:plc:4n6wgsqsqm6q2hjncgwmreey/app.bsky.feed.post/3meg4qvjqojd2"
  },
  "coverImage": {
    "$type": "blob",
    "ref": {
      "$link": "bafkreicoczzs5b6r5ztqvqzivssmbzkoqm3x545ow6gnvmqxh64ok66uuu"
    },
    "mimeType": "image/png",
    "size": 40465
  },
  "path": "/post/45472722",
  "publishedAt": "2026-02-09T08:05:44.000Z",
  "site": "https://programming.dev",
  "tags": [
    "Web Development",
    "punrca",
    "webdev",
    "2 comments",
    "https://blog.cloudflare.com/introducing-pay-per-crawl/"
  ],
  "textContent": "submitted by punrca to webdev\n9 points | 2 comments\nhttps://blog.cloudflare.com/introducing-pay-per-crawl/\n\n> Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content.\n\n> Pay per crawl grants domain owners full control over their monetization strategy. They can define a flat, per-request price across their entire site. Publishers will then have three distinct options for a crawler:\n\n  1. Allow: Grant the crawler free access to content.\n  2. Charge: Require payment at the configured, domain-wide price.\n  3. Block: Deny access entirely, with no option to pay.\n\n\n\nAlthough this is old news, I still found it interesting. Also, I like the “AI Labyrinth” feature of Cloudflare to block AI bots.",
  "title": "Introducing pay per crawl: Enabling content owners to charge AI crawlers for access"
}