Building Local: My 2026 Headless AI Server Journey

Yeah. The Gemma 4 family is amazing. Even though it’s still so new that the backend support isn’t fully polished yet, the generated results are clearly better. I was amazed by the multilingual performance back when Qwen 2.5 and Gemma 2 came out, too… I occasionally test models on Hub (by my Space), focusing mainly on small multilingual LLMs under 14B. It’s just random, spot-checking. Models of the same size have just kept getting better and better over the past few months for years… Rather than a steady pace, every now and then an amazing model pops up.