New KV cache compaction technique cuts LLM memory 50x without accuracy loss

MIT researchers developed Attention Matching, a KV cache compaction technique that compresses LLM memory by 50x in seconds — ...

Nvidia shrinks LLM memory 20x without changing model weights

Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory ...
JD Supra

Prior Art Coherency and Cache Incoherency: “Known-Technique” Rationale for Motivation to Combine

The US Court of Appeals for the Federal Circuit, addressing the issue of whether certain factual and legal conclusions relating to obviousness were supported by substantial evidence, held that the ...