External Publication
Visit Post

How to publish my research in HuggingFace?

Hugging Face Forums [Unofficial] July 4, 2026
Source
And it’s alive! Presenting TIS (Token Importance Scoring) - A new way to compress KV cache Research > ## Token Importance Scoring for KV Cache Compression I have spent some time experimenting with learned token importance for efficient KV cache compression in LLMs. The result is a simple mechanism that works surprisingly well, especially on synthetic retrieval tasks. ### What’s This About Most KV cache compression methods rely on static heuristics (like position-based selection). I asked myself: what if we just learned which tokens matter. It turns out constraint-aware learning is the key - h…

Discussion in the ATmosphere

Loading comments...