v0.1.1 of juice_llm_llamacpp
The official repository for Dart and Flutter packages. [Unoffic…
June 18, 2026
Embedded on-device LLM runtime for juice_llm — an LlamaCppProvider backed by llama.cpp (GGUF, Metal) via llama_cpp_dart. Changelog excerpt: ### Added - chatFormatoption + gemmaChatFormat— for models whose embedded chat template llama.cpp can't apply (Gemma 4 ships tool-use Jinja the runtime can't parse). When set, the prompt is built manually and generation uses the raw session path instead of chat.generate. gemmaChatFormathandles the user … modelformat (no system role — system folds into the first user turn). Verified end-to-end with Gemma 4 E2B; the default (embedded-templa[...]
Discussion in the ATmosphere