Making local LLMs more reliable with a deterministic “context compiler”

Update: pushed this further and added integration examples (OpenWebUI + LiteLLM). One thing that stood out is that “do Y instead of X” breaks much more often than just “don’t do X”. Example: User: use pytest User: use unittest instead of pytest Without a state layer → models often keep using pytest or mix both With it → pytest is removed and unittest is enforced deterministically So it’s not just about constraints drifting out of context — it’s that corrections don’t reliably replace earlier instructions when everything lives in the prompt. Also experimented with mapping natural language into explicit directives first (heuristic + LLM fallback), which helps pick up more constraints without losing determinism. Also working on a TypeScript port with feature parity with the Python version.