SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching
Paper
•
2504.00970
•
Published
•
2
Yuxuan Zhu
zzbright
AI & ML interests
LLM
Organizations
None yet
authored
a
paper
8 months ago