token-eviction

GraphKV

GraphKV: Breaking the Static Selection Paradigm with Graph-Based KV Cache Eviction

GraphKV 用高分源节点与相似邻居间的乘法衰减重排缓存，兼顾重要性与多样性，在小预算事实检索中收益更明显。