Gemma 3 12B: 4-bit Quantization failing/ignored in Transformers v5.1.0 (Gemma3ForConditionalGeneration)
Hugging Face Forums [Unofficial]
April 24, 2026
Just feedback on this post. Memory management were much better after transformers v5.4.0 release. Thanks for everyone’s help.
Discussion in the ATmosphere