#Local Models

Same Agent, Different Score: The Problem With Testing Non-Deterministic AI

Before building tools for my Zork-playing agents, I needed a benchmark I could trust. I ran five local models through fifty playthroughs and discovered that the same model can score 40 or 0 on the sam…

Alessandro Bahgat·Apr 16·14 min read

Stuck in the Maze: Why AI Agents Can't Hold the Map

I had local AI models play Zork, the 1981 text adventure, to study why agents struggle to navigate connected systems. One started responding in Thai. Most scored zero. All got hopelessly stuck in the …

Alessandro Bahgat·Apr 7·8 min read

AI Agents Local Models LLM