{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihwsibfhujvhu6d74c4y66hf3o3aqhqhav32qq2lf2qmwphmwx6dq",
    "uri": "at://did:plc:7fzsvgbjbyp2vxleodbcwyif/app.bsky.feed.post/3mglggumns4l2"
  },
  "path": "/2026/03/08/gguf-runner-update.html",
  "publishedAt": "2026-03-08T00:00:00.000Z",
  "site": "https://jens.dev",
  "tags": [
    "previous post"
  ],
  "textContent": "## A quick follow-up\n\nIn the previous post I introduced **gguf-runner** , a small Rust CLI for running GGUF models locally with a focus on:\n\n  * CPU-only inference\n  * mmap-based model loading\n  * a small, scriptable command line interface\n\n\n\nIf you haven’t read that one yet, it explains the motivation and the general design of the project.\n\nThis post is a follow-up covering some of the more recent additions, most notably **vision support** , along with a few practical improvements like **GitHub release binaries** , better documentation, and a number of performance tweaks.",
  "title": "gguf-runner updates: vision support, releases, and many small improvements"
}