{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihousfqebqkk4qlzpf6pmcecylqujbqoetjrl74bmv7hhx4vynlx4",
    "uri": "at://did:plc:hqad6xwuzg7oqfmwylfkvqfm/app.bsky.feed.post/3mm2r35ck23v2"
  },
  "path": "/viewtopic.php?t=32045&p=274214#p274214",
  "publishedAt": "2026-05-17T15:10:12.000Z",
  "site": "http://forum.palemoon.org",
  "textContent": "> Are we on different Internets? Or are you just making assumptions? Have you tried?\n\nYes, this is from experience looking at my nginx logs. I guess we are on different internets if all the traffic you see dutifully identifies itself as bots.\n\nNo asking nicely with robots.txt will make them go away. No filtering on *bot UAs will make a difference because, as said, I clearly see the bot traffic and they are using Chrome/Safari UAs, often faking Mobile as well. How do I know they are bots? Because they come from tightly-packed IP clusters in datacenters (where you'd expect those requests to come from singular IPs over a keep-alive http), or use distributed networks but those are easy to spot as well because bots do not show predictable \"normal\" browsing patterns, i.e. you will see requests for forum topics with no surrounding traffic at all for navigation or styling, and they often come with session ids in every request (normally handled by cookies) that can even be randomized. Another giveaway is escaped URLs, or even worse half-escaped URLs (when fully-escaped ones obviously get filtered).\nI just got tired of cat&mouse games getting almost daily reports from the host node that there was excessive load and seeing it being yet another subtle variation bypassing a UA filter, so I installed anubis. And it's been blissfully calm ever since and I only on occasion need to adjust the bot policies in it.\n\nSo yeah, a little less doubt about my sincerity would be appreciated.\n\n* * *",
  "title": "Browser Support • Re: Cloudflare Verification Loop issues",
  "updatedAt": "2026-05-17T15:10:12.000Z"
}