gguf-runner updates: vision support, releases, and many small improvements

A quick follow-up

In the previous post I introduced gguf-runner , a small Rust CLI for running GGUF models locally with a focus on:

• CPU-only inference
• mmap-based model loading
• a small, scriptable command line interface

If you haven’t read that one yet, it explains the motivation and the general design of the project.

This post is a follow-up covering some of the more recent additions, most notably vision support , along with a few practical improvements like GitHub release binaries , better documentation, and a number of performance tweaks.