{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihd7ic3uy35qmmrbt4aceibhma5m22t735jjbt3qf2xgrr6hyj7oe",
    "uri": "at://did:plc:lk3jfj3zq4k4wxnk474axylu/app.bsky.feed.post/3mmlxanqis2y2"
  },
  "path": "/t/i-built-arsenic-a-tool-to-analyse-what-actually-changes-when-you-upgrade-models/1381153#post_7",
  "publishedAt": "2026-05-24T11:28:39.000Z",
  "site": "https://community.openai.com",
  "textContent": "Hi.\n\nTotally agree with your points, it is as you say - a different brain. arsenic is an attempt, if you’re relying on a answer being consistent across a model upgrade , to provide some indication that the answer might be subtly different and so your system needs tweaking. Easier if fact based, less so if its conjecture or opinion.\n\n**When someone identifies an AI by name and expects to find equivalent traits in another model, they fundamentally misunderstand the nature of AI** - this 100%, unless you’re under the hood trying to understand the fundamentals of what it is doing it can (and sometimes is) misunderstood as ‘magic’\n\nThanks for the comments!\n-Mark",
  "title": "I built ARSENIC - a tool to analyse what actually changes when you upgrade models"
}