{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreia5plqbzpe4cvqzd5pfop3tsjbuk4nc4zv23shjpce3trical6oqa",
    "uri": "at://did:plc:gapzbf5nl5wxaqkqoecaeawh/app.bsky.feed.post/3mkmbez6zp5v2"
  },
  "path": "/5-facts-about-ai-coding-agents-from-comprehensive-benchmarking/",
  "publishedAt": "2026-04-28T20:34:36.000Z",
  "site": "https://devops.com",
  "tags": [
    "AI",
    "Contributed Content",
    "Social - Facebook",
    "Social - LinkedIn",
    "Social - X",
    "Tools",
    "AI coding agents",
    "benchmarking",
    "developer tools",
    "Large Language Models",
    "software development"
  ],
  "textContent": "AI coding agents are becoming more capable, but evaluating them is harder than it looks. Most benchmarks focus on a single dimension of agent capabilities; for instance, the popular SWE-Bench benchmark only focuses on fixing issues on open source Python repositories. Real-world software engineering involves fixing bugs of course, but it is a lot more […]",
  "title": "5 Facts About AI Coding Agents from Comprehensive Benchmarking"
}