Presenting TIS (Token Importance Scoring) - A new way to compress KV cache
Hugging Face Forums [Unofficial]
July 5, 2026
Your comment reminded me of some of the strategies employed by GLM5 detailed in this paper: https://arxiv.org/pdf/2602.15763
Discussion in the ATmosphere