H
Hacker News
Top
Best
New
Posted by jchandra 2 days ago
High-Fidelity KV Cache Summarization Using Entropy and Low-Rank Reconstruction
(jchandra.com)
14 points
|
1 comments
vivahir215 2 days ago
|
next
[-]
Interesting Approach. Curious about the latency tradeoff: OLS + SVD are much heavier than Top-K.Have you benchmarked end-to-end inference latency?
jchandra 2 days ago
|
parent
[-]
[dead]
jchandra 2 days ago
|
prev
[-]
[dead]